A Variational Proof of Robust Gaussian Noise Stability. Using the calculus of variations, we prove that a Euclidean set of fixed Gaussian measure that nearly maximizes Gaussian noise stability is close to a half space. The main result proves a modification of a conjecture of Eldan from 2013 a robust Borell inequality that removes a logarithmic dependence on the distance of the set to a half space. For sets of Gaussian measure 1 2 , we prove Eldan's 2013 conjecture. The noise stability of a Euclidean set A with correlation rho is the probability that (X,Y) in A times A , where X,Y are standard Gaussian random vectors with correlation rho in( 1,1) . Barchiesi, Brancolini and Julin proved that a Euclidean set of fixed Gaussian measure that nearly minimizes Gaussian surface area is close to a half space, using a variational "penalty function" method. Our proof adapts their method to the more general setting of noise stability. We also show that half spaces are the only sets that are stable (in the sense of second variation) for noise stability, generalizing a result of McGonagle and Ross for Gaussian surface area.


Ideals with linear quotients and componentwise polymatroidal ideals. If I is a monomial ideal with linear quotients, then it has componentwise linear quotients. However, the converse of this statement is an open question. In this paper, we provide two classes of ideals for which the converse of this statement holds. First class is the componentwise polymatroidal ideals in K x,y and the second one is the componentwise polymatroidal ideals with strong exchange property.


Roof BERT Divide Understanding Labour and Join in Work. Recent work on enhancing BERT based language representation models with knowledge graphs (KGs) has promising results on multiple NLP tasks. State of the art approaches typically integrate the original input sentences with triples in KGs, and feed the combined representation into a BERT model. However, as the sequence length of a BERT model is limited, the framework can not contain too much knowledge besides the original input sentences and is thus forced to discard some knowledge. The problem is especially severe for those downstream tasks that input is a long paragraph or even a document, such as QA or reading comprehension tasks. To address the problem, we propose Roof BERT, a model with two underlying BERTs and a fusion layer on them. One of the underlying BERTs encodes the knowledge resources and the other one encodes the original input sentences, and the fusion layer like a roof integrates both BERTs' encodings. Experiment results on QA task reveal the effectiveness of the proposed model.


Learning to Share in Multi Agent Reinforcement Learning. In this paper, we study the problem of networked multi agent reinforcement learning (MARL), where a number of agents are deployed as a partially connected network and each interacts only with nearby agents. Networked MARL requires all agents make decision in a decentralized manner to optimize a global objective with restricted communication between neighbors over the network. Inspired by the fact that textit sharing plays a key role in human's learning of cooperation, we propose LToS, a hierarchically decentralized MARL framework that enables agents to learn to dynamically share reward with neighbors so as to encourage agents to cooperate on the global objective. For each agent, the high level policy learns how to share reward with neighbors to decompose the global objective, while the low level policy learns to optimize local objective induced by the high level policies in the neighborhood. The two policies form a bi level optimization and learn alternately. We empirically demonstrate that LToS outperforms existing methods in both social dilemma and networked MARL scenario.


Profiling Software Developers with Process Mining and N Gram Language Models. Context Profiling developers is challenging since many factors, such as their skills, experience, development environment and behaviors, may influence a detailed analysis and the delivery of coherent interpretations. Objective We aim at profiling software developers by mining their software development process. To do so, we performed a controlled experiment where, in the realm of a Python programming contest, a group of developers had the same well defined set of requirements specifications and a well defined sprint schedule. Events were collected from the PyCharm IDE, and from the Mooshak automatic jury where subjects checked in their code. Method We used n gram language models and text mining to characterize developers' profiles, and process mining algorithms to discover their overall workflows and extract the correspondent metrics for further evaluation. Results Findings show that we can clearly characterize with a coherent rationale most developers, and distinguish the top performers from the ones with more challenging behaviors. This approach may lead ultimately to the creation of a catalog of software development process smells. Conclusions The profile of a developer provides a software project manager a clue for the selection of appropriate tasks he she should be assigned. With the increasing usage of low and no code platforms, where coding is automatically generated from an upper abstraction layer, mining developer's actions in the development platforms is a promising approach to early detect not only behaviors but also assess project complexity and model effort.


Local global principles for homogeneous spaces over some two dimensional geometric global fields. In this article, we study the obstructions to the local global principle for homogeneous spaces with connected or abelian stabilizers over finite extensions of the field mathbb C ((x,y)) of Laurent series in two variables over the complex numbers and over function fields of curves over mathbb C ((t)) . We give examples that prove that the usual Brauer Manin obstruction is not enough to explain the failure of the local global principle, and we then construct a variant of this obstruction using torsors under quasi trivial tori which turns out to work. In the end of the article, we compare this new obstruction to the descent obstruction with respect to torsors under tori. For that purpose, we use a result on towers of torsors, that is of independent interest and therefore is proved in a separate appendix.


Caption Enriched Samples for Improving Hateful Memes Detection. The recently introduced hateful meme challenge demonstrates the difficulty of determining whether a meme is hateful or not. Specifically, both unimodal language models and multimodal vision language models cannot reach the human level of performance. Motivated by the need to model the contrast between the image content and the overlayed text, we suggest applying an off the shelf image captioning tool in order to capture the first. We demonstrate that the incorporation of such automatic captions during fine tuning improves the results for various unimodal and multimodal models. Moreover, in the unimodal case, continuing the pre training of language models on augmented and original caption pairs, is highly beneficial to the classification accuracy.


Anatomy of OntoGUM Adapting GUM to the OntoNotes Scheme to Evaluate Robustness of SOTA Coreference Algorithms. SOTA coreference resolution produces increasingly impressive scores on the OntoNotes benchmark. However lack of comparable data following the same scheme for more genres makes it difficult to evaluate generalizability to open domain data. Zhu et al. (2021) introduced the creation of the OntoGUM corpus for evaluating geralizability of the latest neural LM based end to end systems. This paper covers details of the mapping process which is a set of deterministic rules applied to the rich syntactic and discourse annotations manually annotated in the GUM corpus. Out of domain evaluation across 12 genres shows nearly 15 20 degradation for both deterministic and deep learning systems, indicating a lack of generalizability or covert overfitting in existing coreference resolution models.


Semantic Feature Extraction for Generalized Zero shot Learning. Generalized zero shot learning (GZSL) is a technique to train a deep learning model to identify unseen classes using the attribute. In this paper, we put forth a new GZSL technique that improves the GZSL classification performance greatly. Key idea of the proposed approach, henceforth referred to as semantic feature extraction based GZSL (SE GZSL), is to use the semantic feature containing only attribute related information in learning the relationship between the image and the attribute. In doing so, we can remove the interference, if any, caused by the attribute irrelevant information contained in the image feature. To train a network extracting the semantic feature, we present two novel loss functions, 1) mutual information based loss to capture all the attribute related information in the image feature and 2) similarity based loss to remove unwanted attribute irrelevant information. From extensive experiments using various datasets, we show that the proposed SE GZSL technique outperforms conventional GZSL approaches by a large margin.


Divergence error based p adaptive discontinuous Galerkin solution of time domain Maxwell's equations. A p adaptive discontinuous Galerkin time domain method is developed to obtain high order solutions to electromagnetic scattering problems. A novel feature of the proposed method is the use of divergence error to drive the p adaptive method. The nature of divergence error is explored and that it is a direct consequence of the act of discretization is established. Its relation with relative truncation error is formed which enables the use of divergence error as an inexpensive proxy to truncation error. Divergence error is used as an indicator to dynamically identify and assign spatial operators of varying accuracy to substantial regions in the computational domain. This results in a reduced computational cost than a comparable discontinuous Galerkin time domain solution using uniform degree piecewise polynomial bases throughout.


Escaping Poor Local Minima in Large Scale Robust Estimation. Robust parameter estimation is a crucial task in several 3D computer vision pipelines such as Structure from Motion (SfM). State of the art algorithms for robust estimation, however, still suffer from difficulties in converging to satisfactory solutions due to the presence of many poor local minima or flat regions in the optimization landscapes. In this paper, we introduce two novel approaches for robust parameter estimation. The first algorithm utilizes the Filter Method (FM), which is a framework for constrained optimization allowing great flexibility in algorithmic choices, to derive an adaptive kernel scaling strategy that enjoys a strong ability to escape poor minima and achieves fast convergence rates. Our second algorithm combines a generalized Majorization Minimization (GeMM) framework with the half quadratic lifting formulation to obtain a simple yet efficient solver for robust estimation. We empirically show that both proposed approaches show encouraging capability on avoiding poor local minima and achieve competitive results compared to existing state of the art robust fitting algorithms.


Online learning of windmill time series using Long Short term Cognitive Networks. Forecasting windmill time series is often the basis of other processes such as anomaly detection, health monitoring, or maintenance scheduling. The amount of data generated on windmill farms makes online learning the most viable strategy to follow. Such settings require retraining the model each time a new batch of data is available. However, update the model with the new information is often very expensive to perform using traditional Recurrent Neural Networks (RNNs). In this paper, we use Long Short term Cognitive Networks (LSTCNs) to forecast windmill time series in online settings. These recently introduced neural systems consist of chained Short term Cognitive Network blocks, each processing a temporal data chunk. The learning algorithm of these blocks is based on a very fast, deterministic learning rule that makes LSTCNs suitable for online learning tasks. The numerical simulations using a case study with four windmills showed that our approach reported the lowest forecasting errors with respect to a simple RNN, a Long Short term Memory, a Gated Recurrent Unit, and a Hidden Markov Model. What is perhaps more important is that the LSTCN approach is significantly faster than these state of the art models.


Prediction, Selection, and Generation Exploration of Knowledge Driven Conversation System. In open domain conversational systems, it is important but challenging to leverage background knowledge. We can use the incorporation of knowledge to make the generation of dialogue controllable, and can generate more diverse sentences that contain real knowledge. In this paper, we combine the knowledge bases and pre training model to propose a knowledge driven conversation system. The system includes modules such as dialogue topic prediction, knowledge matching and dialogue generation. Based on this system, we study the performance factors that maybe affect the generation of knowledge driven dialogue topic coarse recall algorithm, number of knowledge choices, generation model choices, etc., and finally made the system reach state of the art. These experimental results will provide some guiding significance for the future research of this task. As far as we know, this is the first work to study and analyze the effects of the related factors.


Neuro Symbolic AI An Emerging Class of AI Workloads and their Characterization. Neuro symbolic artificial intelligence is a novel area of AI research which seeks to combine traditional rules based AI approaches with modern deep learning techniques. Neuro symbolic models have already demonstrated the capability to outperform state of the art deep learning models in domains such as image and video reasoning. They have also been shown to obtain high accuracy with significantly less training data than traditional models. Due to the recency of the field's emergence and relative sparsity of published results, the performance characteristics of these models are not well understood. In this paper, we describe and analyze the performance characteristics of three recent neuro symbolic models. We find that symbolic models have less potential parallelism than traditional neural models due to complex control flow and low operational intensity operations, such as scalar multiplication and tensor addition. However, the neural aspect of computation dominates the symbolic part in cases where they are clearly separable. We also find that data movement poses a potential bottleneck, as it does in many ML workloads.


Extensions of monotone operators into compact sets. Abstract Extensions of monotone operators into compact sets of a dual system are studied under general conditions.


Natural Hot Ion Modes in a Rotating Plasma. In steady state, the fuel cycle of a fusion plasma requires inward particle fluxes of fuel ions. These particle flows are also accompanied by heating. In the case of classical transport in a rotating cylindrical plasma, this heating can proceed through several distinct channels depending on the physical mechanisms involved. Some channels directly heat the fuel ions themselves, whereas others heat electrons. Which channel dominates depends, in general, on the details of the temperature, density, and rotation profiles of the plasma constituents. However, remarkably, under relatively few assumptions concerning these profiles, if the alpha particles, the byproducts of the fusion reaction, can be removed directly by other means, a hot ion mode tends to emerge naturally.


Comparison of Grammatical Error Correction Using Back Translation Models. Grammatical error correction (GEC) suffers from a lack of sufficient parallel data. Therefore, GEC studies have developed various methods to generate pseudo data, which comprise pairs of grammatical and artificially produced ungrammatical sentences. Currently, a mainstream approach to generate pseudo data is back translation (BT). Most previous GEC studies using BT have employed the same architecture for both GEC and BT models. However, GEC models have different correction tendencies depending on their architectures. Thus, in this study, we compare the correction tendencies of the GEC models trained on pseudo data generated by different BT models, namely, Transformer, CNN, and LSTM. The results confirm that the correction tendencies for each error type are different for every BT model. Additionally, we examine the correction tendencies when using a combination of pseudo data generated by different BT models. As a result, we find that the combination of different BT models improves or interpolates the F 0.5 scores of each error type compared with that of single BT models with different seeds.


Unveiling Symmetry Protection of Bound States in the Continuum with Terahertz Near field Imaging. Bound states in the continuum (BICs) represent a new paradigm in photonics due to the full suppression of radiation losses. However, this suppression has also hampered their direct observation. By using a double terahertz (THz) near field technique that allows the local excitation and detection of the THz amplitude, we are able to map for the first time the electromagnetic field of BICs over extended areas, unveiling the field symmetry protection that suppresses far field radiation. This investigation, done for metasurfaces of dimer rod resonators, reveals the in plane extension and formation of BICs with anti symmetric phases, in agreement with coupled dipole calculations. By displacing the rods, we demonstrate that mirror symmetry is not a necessary condition for BIC formation. Only pi rotation symmetry is required, making BICs exceptionally robust to structural changes. This work makes the local field of BICs experimentally accessible, which is crucial for the engineering of cavities with infinite lifetimes.


A slightly better bound on the crossing number in terms of the pair crossing number. The crossing number of a graph G , mbox cr (G) , is the minimum number of crossings, the pair crossing number, mbox pcr (G) , is the minimum number of pairs of crossing edges over all drawings of G . In this note we show that mbox cr (G) O( mbox pcr (G) 3 2 log mbox pcr (G)) , which is an improvement of the result of Matou v s ek, by a log factor.


Third party Evaluation of Robotic Hand Designs Using a Mechanical Glove. A robotic hand design suitable for dexterity should be examined using functional tests. To achieve this, we designed a mechanical glove, which is a rigid wearable glove that enables us to develop the corresponding isomorphic robotic hand and evaluate its hardware properties. Subsequently, the effectiveness of multiple degrees of freedom (DOFs) was evaluated by human participants. Several fine motor skills were evaluated using the mechanical glove under two conditions one and three DOF conditions. To the best of our knowledge, this is the first extensive evaluation method for robotic hand designs suitable for dexterity. (This paper was peer reviewed and is the full translation from the Journal of the Robotics Society of Japan, Vol.39, No.6, pp.557 560, 2021.)


MOEA D with Adaptative Number of Weight Vectors. The Multi Objective Evolutionary Algorithm based on Decomposition (MOEA D) is a popular algorithm for solving Multi Objective Problems (MOPs). The main component of MOEA D is to decompose a MOP into easier sub problems using a set of weight vectors. The choice of the number of weight vectors significantly impacts the performance of MOEA D. However, the right choice for this number varies, given different MOPs and search stages. Here we adaptively change the number of vectors by removing unnecessary vectors and adding new ones in empty areas of the objective space. Our MOEA D variant uses the Consolidation Ratio to decide when to change the number of vectors, and then it decides where to add or remove these weighted vectors. We investigate the effects of this adaptive MOEA D against MOEA D with a poorly chosen set of vectors, a MOEA D with fine tuned vectors and MOEA D AWA on the DTLZ and ZDT benchmark functions. We analyse the algorithms in terms of hypervolume, IGD and entropy performance. Our results show that the proposed method is equivalent to MOEA D with fine tuned vectors and superior to MOEA D with poorly defined vectors. Thus, our adaptive mechanism mitigates problems related to the choice of the number of weight vectors in MOEA D, increasing the final performance of MOEA D by filling empty areas of the objective space while avoiding premature stagnation of the search progress.


Higher dimensional stick percolation. We consider two cases of the so called stick percolation model with sticks of length L. In the first case, the orientation is chosen independently and uniformly, while in the second all sticks are oriented along the same direction. We study their respective critical values lambda c(L) of the percolation phase transition, and in particular we investigate the asymptotic behavior of lambda c(L) as L to infty for both of these cases. In the first case we prove that lambda c(L) sim L 2 for any d geq 2, while in the second we prove that lambda c(L) sim L 1 for any d geq 2.


mSHINE A Multiple meta paths Simultaneous Learning Framework for Heterogeneous Information Network Embedding. Heterogeneous information networks(HINs) become popular in recent years for its strong capability of modelling objects with abundant information using explicit network structure. Network embedding has been proved as an effective method to convert information networks into lower dimensional space, whereas the core information can be well preserved. However, traditional network embedding algorithms are sub optimal in capturing rich while potentially incompatible semantics provided by HINs. To address this issue, a novel meta path based HIN representation learning framework named mSHINE is designed to simultaneously learn multiple node representations for different meta paths. More specifically, one representation learning module inspired by the RNN structure is developed and multiple node representations can be learned simultaneously, where each representation is associated with one respective meta path. By measuring the relevance between nodes with the designed objective function, the learned module can be applied in downstream link prediction tasks. A set of criteria for selecting initial meta paths is proposed as the other module in mSHINE which is important to reduce the optimal meta path selection cost when no prior knowledge of suitable meta paths is available. To corroborate the effectiveness of mSHINE, extensive experimental studies including node classification and link prediction are conducted on five real world datasets. The results demonstrate that mSHINE outperforms other state of the art HIN embedding methods.


Spirality and Rectilinear Planarity Testing of Independent Parallel SP Graphs. We study the long standing open problem of efficiently testing rectilinear planarity of series parallel graphs (SP graphs) in the variable embedding setting. A key ingredient behind the design of a linear time testing algorithm for SP graphs of vertex degree at most three is that one can restrict the attention to a constant number of rectilinear shapes'' for each series or parallel component. To formally describe these shapes the notion of spirality can be used. This key ingredient no longer holds for SP graphs with vertices of degree four, as we prove a logarithmic lower bound on the spirality of their components. The bound holds even for the independent parallel SP graphs, in which no two parallel components share a pole. Nonetheless, by studying the spirality properties of the independent parallel SP graphs, we are able to design a linear time rectilinear planarity testing algorithm for this graph family.


p K "ahler and balanced structures on nilmanifolds with nilpotent complex structures. Let (X,J) be a nilmanifold with a left invariant nilpotent complex structure. We study the existence of p K "ahler structures (which include K "ahler and balanced metrics) on X . More precisely, we determine an optimal p such that there are no p K "ahler structures on X . Finally, we show that, contrarily to the K "ahler case, on compact complex manifolds there is no relation between the existence of balanced metrics and the degeneracy step of the Fr "olicher spectral sequence. More precisely, on balanced manifolds the degeneracy step can be arbitrarily large.


Pattern avoidance and dominating compositions. Jel 'inek, Mansour, and Shattuck studied Wilf equivalence among pairs of patterns of the form sigma, tau where sigma is a set partition of size 3 with at least two blocks. They obtained an upper bound for the number of Wilf equivalence classes for such pairs. We show that their upper bound is the exact number of equivalence classes, thus solving a problem posed by them.


Mechanical TA 2 A System for Peer Grading with TA Support. Mechanical TA 2 (MTA2) is an open source web based peer grading application that leverages trusted TA graders to incentivize high quality peer review. A previous, prototype implementation of MTA proved the value of the concept, but was neither suitable for use at scale nor easily extensible MTA2 is a complete reimplementation of the system that overcomes these hurdles. MTA2 serves two, interconnected purposes facilitating practical peer grading and serving as a testbed for experimentation with different peer grading mechanisms. The system is characterized by a modular design that makes customization easy support for dividing students into different pools based on their peer grading prowess mechanisms for automated calibration and spot checking and the ability for students to appeal grades and to give feedback about individual reviews.


SLURP Side Learning Uncertainty for Regression Problems. It has become critical for deep learning algorithms to quantify their output uncertainties to satisfy reliability constraints and provide accurate results. Uncertainty estimation for regression has received less attention than classification due to the more straightforward standardized output of the latter class of tasks and their high importance. However, regression problems are encountered in a wide range of applications in computer vision. We propose SLURP, a generic approach for regression uncertainty estimation via a side learner that exploits the output and the intermediate representations generated by the main task model. We test SLURP on two critical regression tasks in computer vision monocular depth and optical flow estimation. In addition, we conduct exhaustive benchmarks comprising transfer to different datasets and the addition of aleatoric noise. The results show that our proposal is generic and readily applicable to various regression problems and has a low computational cost with respect to existing solutions.


Modelling Direct Messaging Networks with Multiple Recipients for Cyber Deception. Cyber deception is emerging as a promising approach to defending networks and systems against attackers and data thieves. However, despite being relatively cheap to deploy, the generation of realistic content at scale is very costly, due to the fact that rich, interactive deceptive technologies are largely hand crafted. With recent improvements in Machine Learning, we now have the opportunity to bring scale and automation to the creation of realistic and enticing simulated content. In this work, we propose a framework to automate the generation of email and instant messaging style group communications at scale. Such messaging platforms within organisations contain a lot of valuable information inside private communications and document attachments, making them an enticing target for an adversary. We address two key aspects of simulating this type of system modelling when and with whom participants communicate, and generating topical, multi party text to populate simulated conversation threads. We present the LogNormMix Net Temporal Point Process as an approach to the first of these, building upon the intensity free modeling approach of Shchur et al. cite shchur2019intensity to create a generative model for unicast and multi cast communications. We demonstrate the use of fine tuned, pre trained language models to generate convincing multi party conversation threads. A live email server is simulated by uniting our LogNormMix Net TPP (to generate the communication timestamp, sender and recipients) with the language model, which generates the contents of the multi party email threads. We evaluate the generated content with respect to a number of realism based properties, that encourage a model to learn to generate content that will engage the attention of an adversary to achieve a deception outcome.


On the non existence of stepped pressure equilibria far from symmetry. The Stepped Pressure Equilibrium Code (SPEC) Hudson et al., Phys. Plasmas 19, 112502 (2012) has been successful in the construction of equilibria in 3D configurations that contain a mixture of flux surfaces, islands and chaotic magnetic field lines. In this model, the plasma is sliced into sub volumes separated by ideal interfaces, and in each volume the magnetic field is a Beltrami field. In the cases where the system is far from possessing a continuous symmetry, such as in stellarators, the existence of solutions to a stepped pressure equilibrium with given constraints, such as a multi region relaxed MHD minimum energy state, is not guaranteed but is often taken for granted. Using SPEC, we have studied two different scenarios in which a solution fails to exist in a slab with analytic boundary perturbations. We found that with a large boundary perturbation, a certain interface becomes fractal, corresponding to the break up of a Kolmogorov Arnold Moser (KAM) surface. Moreover, an interface can only support a maximum pressure jump while a solution of the magnetic field consistent with the force balance condition can be found. An interface closer to break up can support a smaller pressure jump. We discovered that the pressure jump can push the interface closer to being non smooth through force balance, thus significantly decreasing the maximum pressure it can support. Our work shows that a convergence study must be performed on a SPEC equilibrium with interfaces close to break up. These results may also provide insights into the choice of interfaces and have applications in finding out the maximum pressure a machine can support.


Effective Model Integration Algorithm for Improving Link and Sign Prediction in Complex Networks. Link and sign prediction in complex networks bring great help to decision making and recommender systems, such as in predicting potential relationships or relative status levels. Many previous studies focused on designing the special algorithms to perform either link prediction or sign prediction. In this work, we propose an effective model integration algorithm consisting of network embedding, network feature engineering, and an integrated classifier, which can perform the link and sign prediction in the same framework. Network embedding can accurately represent the characteristics of topological structures and cooperate with the powerful network feature engineering and integrated classifier can achieve better prediction. Experiments on several datasets show that the proposed model can achieve state of the art or competitive performance for both link and sign prediction in spite of its generality. Interestingly, we find that using only very low network embedding dimension can generate high prediction performance, which can significantly reduce the computational overhead during training and prediction. This study offers a powerful methodology for multi task prediction in complex networks.


Simulating dense granular flow using the mu ( I ) rheology within a space time framework. A space time framework is applied to simulate dense granular flow. Two different numerical experiments are performed a column collapse and a dam break on an inclined plane. The experiments are modeled as two phase flows. The dense granular material is represented by a constitutive model, the mu ( I ) rheology, that is based on the Coulomb's friction law, such that the normal stress applied by the pressure is related to the tangential stress. The model represents a complex shear thinning viscoplastic material behavior. The interface between the dense granular material and the surrounding light fluid is captured with a level set function. Due to discontinuities close to the the interface, the mesh requires a sufficient resolution. The space time approach allows unstructured meshes in time and, therefore a well refined mesh in the temporal direction around the interface. In this study, results and performance of a flat and a simplex space time discretization are verified and analyzed.


Manually Annotated Spelling Error Corpus for Amharic. This paper presents a manually annotated spelling error corpus for Amharic, lingua franca in Ethiopia. The corpus is designed to be used for the evaluation of spelling error detection and correction. The misspellings are tagged as non word and real word errors. In addition, the contextual information available in the corpus makes it useful in dealing with both types of spelling errors.


Angular momentum redirection phase of vector beams in a non planar geometry. An electric field propagating along a non planar path can acquire geometric phases. Previously, geometric phases have been linked to spin redirection and independently to spatial mode transformation, resulting in the rotation of polarisation and intensity profiles, respectively. We investigate the non planar propagation of scalar and vector light fields and demonstrate that polarisation and intensity profiles rotate by the same angle. The geometric phase acquired is proportional to j l sigma, where l is the topological charge and sigma is the helicity. Radial and azimuthally polarised beams with j 0 are eigenmodes of the system and are not affected by the geometric path. The effects considered here are relevant for systems relying on photonic spin Hall effects, polarisation and vector microscopy, as well as topological optics in communication systems


Second obstruction to pseudoisotopy in dimension 3. We use lens shaped models and the second obstruction to pseudoisotopy to construct a nontrivial diffeomorphism of M times I where M is the connected sum of S 1 times S 2 with a another nonsimply connected 3 manifold M' . Then we take two copies of this diffeomorphism and paste together their tops and bottoms to obtain a diffeomorphism of M times S 1 . Properties of the second obstruction and the first Postnikov invariant imply that this diffeomorphism of the closed 4 manifold M times S 1 is not isotopic to the identity. Similar results were obtain by Singh 10 .


Chaotic to Fine Clustering for Unlabeled Plant Disease Images. Current annotation for plant disease images depends on manual sorting and handcrafted features by agricultural experts, which is time consuming and labour intensive. In this paper, we propose a self supervised clustering framework for grouping plant disease images based on the vulnerability of Kernel K means. The main idea is to establish a cross iterative under clustering algorithm based on Kernel K means to produce the pseudo labeled training set and a chaotic cluster to be further classified by a deep learning module. In order to verify the effectiveness of our proposed framework, we conduct extensive experiments on three different plant disease datatsets with five plants and 17 plant diseases. The experimental results show the high superiority of our method to do image based plant disease classification over balanced and unbalanced datasets by comparing with five state of the art existing works in terms of different metrics.


An extended and more practical mwp flow analysis. We improve and refine a method for certifying that the values' sizes computed by an imperative program will be bounded by polynomials in the program's inputs' sizes. Our work ''tames'' the non determinism of the original analysis, and offers an innovative way of completing the analysis when a non polynomial growth is found. We furthermore enrich the analyzed language by adding function definitions and calls, allowing to compose the analysis of different libraries and offering generally more modularity. The implementation of our improved method, discussed in a tool paper (https hal.archives ouvertes.fr hal 03269121), also required to reason about the efficiency of some of the needed operations on the matrices produced by the analysis. It is our hope that this work will enable and facilitate static analysis of source code to guarantee its correctness with respect to resource usages.


Augmenting Supervised Learning by Meta learning Unsupervised Local Rules. The brain performs unsupervised learning and (perhaps) simultaneous supervised learning. This raises the question as to whether a hybrid of supervised and unsupervised methods will produce better learning. Inspired by the rich space of Hebbian learning rules, we set out to directly learn the unsupervised learning rule on local information that best augments a supervised signal. We present the Hebbian augmented training algorithm (HAT) for combining gradient based learning with an unsupervised rule on pre synpatic activity, post synaptic activities, and current weights. We test HAT's effect on a simple problem (Fashion MNIST) and find consistently higher performance than supervised learning alone. This finding provides empirical evidence that unsupervised learning on synaptic activities provides a strong signal that can be used to augment gradient based methods. We further find that the meta learned update rule is a time varying function thus, it is difficult to pinpoint an interpretable Hebbian update rule that aids in training. We do find that the meta learner eventually degenerates into a non Hebbian rule that preserves important weights so as not to disturb the learner's convergence.


Unravelling the Full Relaxation Dynamics of Superexcited Helium Nanodroplets. The relaxation dynamics of superexcited superfluid He nanodroplets is thoroughly investigated by means of extreme ultraviolet (XUV) femtosecond electron and ion spectroscopy complemented by time dependent density functional theory (TDDFT). Three main paths leading to the emission of electrons and ions are identified Droplet autoionization, pump probe photoionization, and autoionization induced by re excitation of droplets relaxing into levels below the droplet ionization threshold. The most abundant product of both droplet autoionization and photoionization is He 2 , whereas the delayed appearance of He is indicative of the ejection of excited He atoms from the droplets. The state resolved time dependent photoelectron spectra reveal that intermediate excited states of the droplets are populated in the course of the relaxation, terminating in the lowest lying metastable singlet and triplet He atomic states. The slightly faster relaxation of the triplet state compared to the singlet state is in agreement with the simulation showing faster formation of a bubble around a He atom in the triplet state.


The Arinkin Gaitsgory temperedness conjecture. Arinkin and Gaitsgory defined a category of tempered D modules on Bun G that is conjecturally equivalent to the category of quasi coherent (not ind coherent!) sheaves on LocSys check G . However, their definition depends on the auxiliary data of a point of the curve they conjectured that their definition is independent of this choice. Beraldo has outlined a proof of this conjecture that depends on some technology that is not currently available. Here we provide a short, unconditional proof of the Arinkin Gaitsgory conjecture.


Correlated evolution models and methods. In this article, we review the different models and methods to understand and estimate correlated evolution within the same genome, individual or species. We describe correlated evolution among traits, among genetic components and finally between traits and genetics.


Coprime values of polynomials in several variables. Given two polynomials P( underline x) , Q( underline x) in one or more variables and with integer coefficients, how does the property that they are coprime relate to their values P( underline n), Q( underline n) at integer points underline n being coprime? We show that the set of all gcd (P( underline n), Q( underline n)) is stable under gcd and under lcm. A notable consequence is a result of Schinzel if in addition P and Q have no fixed prime divisor (i.e., no prime dividing all values P( underline n) , Q( underline n) ), then P and Q assume coprime values at "many" integer points. Conversely we show that if "sufficiently many" integer points yield values that are coprime (or of small gcd) then the original polynomials must be coprime. Another noteworthy consequence of this paper is a version over the ring of integers of Hilbert's irreducibility theorem.


Responsible AI Challenges in End to end Machine Learning. Responsible AI is becoming critical as AI is widely used in our everyday lives. Many companies that deploy AI publicly state that when training a model, we not only need to improve its accuracy, but also need to guarantee that the model does not discriminate against users (fairness), is resilient to noisy or poisoned data (robustness), is explainable, and more. In addition, these objectives are not only relevant to model training, but to all steps of end to end machine learning, which include data collection, data cleaning and validation, model training, model evaluation, and model management and serving. Finally, responsible AI is conceptually challenging, and supporting all the objectives must be as easy as possible. We thus propose three key research directions towards this vision depth, breadth, and usability to measure progress and introduce our ongoing research. First, responsible AI must be deeply supported where multiple objectives like fairness and robust must be handled together. To this end, we propose FR Train, a holistic framework for fair and robust model training in the presence of data bias and poisoning. Second, responsible AI must be broadly supported, preferably in all steps of machine learning. Currently we focus on the data pre processing steps and propose Slice Tuner, a selective data acquisition framework for training fair and accurate models, and MLClean, a data cleaning framework that also improves fairness and robustness. Finally, responsible AI must be usable where the techniques must be easy to deploy and actionable. We propose FairBatch, a batch selection approach for fairness that is effective and simple to use, and Slice Finder, a model evaluation tool that automatically finds problematic slices. We believe we scratched the surface of responsible AI for end to end machine learning and suggest research challenges moving forward.


Accurate and robust splitting methods for the generalized Langevin equation with a positive Prony series memory kernel. We study numerical methods for the generalized Langevin equation (GLE) with a positive Prony series memory kernel, in which case the GLE can be written in an extended variable Markovian formalism. We propose a new splitting method that is easy to implement and is able to substantially improve the accuracy and robustness of GLE simulations in a wide range of the parameters. An error analysis is performed in the case of a one dimensional harmonic oscillator, revealing that all but one averages are exact for the newly proposed method. Various numerical experiments in both equilibrium and nonequilibrium simulations are also conducted to demonstrate the superiority of the newly proposed method over popular alternative schemes in interacting multi particle systems.


SPACE A Simulator for Physical Interactions and Causal Learning in 3D Environments. Recent advancements in deep learning, computer vision, and embodied AI have given rise to synthetic causal reasoning video datasets. These datasets facilitate the development of AI algorithms that can reason about physical interactions between objects. However, datasets thus far have primarily focused on elementary physical events such as rolling or falling. There is currently a scarcity of datasets that focus on the physical interactions that humans perform daily with objects in the real world. To address this scarcity, we introduce SPACE A Simulator for Physical Interactions and Causal Learning in 3D Environments. The SPACE simulator allows us to generate the SPACE dataset, a synthetic video dataset in a 3D environment, to systematically evaluate physics based models on a range of physical causal reasoning tasks. Inspired by daily object interactions, the SPACE dataset comprises videos depicting three types of physical events containment, stability and contact. These events make up the vast majority of the basic physical interactions between objects. We then further evaluate it with a state of the art physics based deep model and show that the SPACE dataset improves the learning of intuitive physics with an approach inspired by curriculum learning. Repository https github.com jiafei1224 SPACE


BembaSpeech A Speech Recognition Corpus for the Bemba Language. We present a preprocessed, ready to use automatic speech recognition corpus, BembaSpeech, consisting over 24 hours of read speech in the Bemba language, a written but low resourced language spoken by over 30 of the population in Zambia. To assess its usefulness for training and testing ASR systems for Bemba, we train an end to end Bemba ASR system by fine tuning a pre trained DeepSpeech English model on the training portion of the BembaSpeech corpus. Our best model achieves a word error rate (WER) of 54.78 . The results show that the corpus can be used for building ASR systems for Bemba. The corpus and models are publicly released at https github.com csikasote BembaSpeech.


A class of high order weighted compact central schemes for solving hyperbolic conservation laws. We propose a class of weighted compact central (WCC) schemes for solving hyperbolic conservation laws. The linear version can be considered as a high order extension of the central Lax Friedrichs (LxF) scheme and the central conservation element and solution element (CESE) scheme. On every cell, the solution is approximated by a Pth order polynomial of which all the DOFs are stored and updated separately. The cell average is updated by a classical finite volume scheme which is constructed based on space time staggered meshes such that the fluxes are continuous across the interfaces of the adjacent control volumes and, therefore, the local Riemann problem is bypassed. The kth order spatial derivatives are updated by a central difference of (k 1)th order spatial derivatives at cell vertices. All the space time information is calculated by the Cauchy Kovalewski procedure. By doing so, the schemes are able to achieve arbitrarily uniform spacetime high order on a super compact stencil with only one explicit time step. In order to capture discontinuities without spurious oscillations, a weighted essentially non oscillatory (WENO) type limiter is tailor made for the schemes. The limiter preserves the compactness and high order accuracy of the schemes. The accuracy, robustness, and efficiency of the schemes are verified by several numerical examples of scalar conservation laws and the compressible Euler equations.


SSMF Shifting Seasonal Matrix Factorization. Given taxi ride counts information between departure and destination locations, how can we forecast their future demands? In general, given a data stream of events with seasonal patterns that innovate over time, how can we effectively and efficiently forecast future events? In this paper, we propose Shifting Seasonal Matrix Factorization approach, namely SSMF, that can adaptively learn multiple seasonal patterns (called regimes), as well as switching between them. Our proposed method has the following properties (a) it accurately forecasts future events by detecting regime shifts in seasonal patterns as the data stream evolves (b) it works in an online setting, i.e., processes each observation in constant time and memory (c) it effectively realizes regime shifts without human intervention by using a lossless data compression scheme. We demonstrate that our algorithm outperforms state of the art baseline methods by accurately forecasting upcoming events on three real world data streams.


Transverse K "ahler holonomy in Sasaki Geometry and oldmathcal S Stability. We study the transverse K "ahler holonomy groups on Sasaki manifolds (M, oldmathcal S ) and their stability properties under transverse holomorphic deformations of the characteristic foliation by the Reeb vector field. In particular, we prove that when the first Betti number b 1(M) and the basic Hodge number h 0,2 B( oldmathcal S ) vanish, then oldmathcal S is stable under deformations of the transverse K "ahler flow. In addition we show that an irreducible transverse hyperk "ahler Sasakian structure is oldmathcal S unstable, whereas, an irreducible transverse Calabi Yau Sasakian structure is oldmathcal S stable when dim M geq 7 . Finally, we prove that the standard Sasaki join operation (transverse holonomy U(n 1) times U(n 2) ) as well as the fiber join operation preserve oldmathcal S stability.


Sensitivity analysis in differentially private machine learning using hybrid automatic differentiation. In recent years, formal methods of privacy protection such as differential privacy (DP), capable of deployment to data driven tasks such as machine learning (ML), have emerged. Reconciling large scale ML with the closed form reasoning required for the principled analysis of individual privacy loss requires the introduction of new tools for automatic sensitivity analysis and for tracking an individual's data and their features through the flow of computation. For this purpose, we introduce a novel textit hybrid automatic differentiation (AD) system which combines the efficiency of reverse mode AD with an ability to obtain a closed form expression for any given quantity in the computational graph. This enables modelling the sensitivity of arbitrary differentiable function compositions, such as the training of neural networks on private data. We demonstrate our approach by analysing the individual DP guarantees of statistical database queries. Moreover, we investigate the application of our technique to the training of DP neural networks. Our approach can enable the principled reasoning about privacy loss in the setting of data processing, and further the development of automatic sensitivity analysis and privacy budgeting systems.


Reason Against the Machine Future Directions for Mass Online Deliberation. Designers of online deliberative platforms aim to counter the degrading quality of online debates. Support technologies such as machine learning and natural language processing open avenues for widening the circle of people involved in deliberation, moving from small groups to "crowd" scale. Numerous design features of large scale online discussion systems allow larger numbers of people to discuss shared problems, enhance critical thinking, and formulate solutions. We review the transdisciplinary literature on the design of digital mass deliberation platforms and examine the commonly featured design aspects (e.g., argumentation support, automated facilitation, and gamification) that attempt to facilitate scaling up. We find that the literature is largely focused on developing technical fixes for scaling up deliberation, but may neglect the more nuanced requirements of high quality deliberation. Current design research is carried out with a small, atypical segment of the world's population, and much research is still needed on how to facilitate and accommodate different genders or cultures in deliberation, how to deal with the implications of pre existing social inequalities, how to build motivation and self efficacy in certain groups, and how to deal with differences in cognitive abilities and cultural or linguistic differences. Few studies bridge disciplines between deliberative theory, design and engineering. As a result, scaling up deliberation will likely advance in separate systemic siloes. We make design and process recommendations to correct this course and suggest avenues for future research


Amenability of semigroups and common multiples in ell 1 . In this note, we prove that a semigroup S is left amenable if and only if every two nonzero elements of ell 1 (S) have a common nonzero right multiple, where ell 1 (S) is the positive part of the Banach algebra ell 1(S) , or equivalently the semiring of finite measures on S . This characterization of amenability is new even for groups.


Extending functions from Nikolskii Besov spaces of mixed smoothness beyond domains of certain kind. The article examines Nikolskii and Besov spaces with norms defined using " L p averaged" mixed moduli of continuity of functions of appropriate orders, instead of mixed moduli of continuity of known orders for certain mixed derivative functions. For such spaces of functions defined in bounded domains of m kind (in a broad sense), the author builds continuous linear mappings of those spaces to ordinary Nikolskii and Besov spaces of mixed smoothness in mathbb R d , that are function extension operators, thus incurring coincidence of both categories of spaces defined in the said domains.


"Is My Mic On?" Preparing SE Students for Collaborative Remote Work and Hybrid Team Communication. Communication is essential for the success of student and professional software engineering (SE) team development projects. The projects delivered by SE courses provide valuable learning experiences for students because they teach industry required skills such as teamwork, communication, and scheduling. Professional SE teams have adopted communication software such as Slack, Miro, Microsoft Teams, and GitHub Discussions to share files and convey information between team members. Likewise, they have distributed software development tools such as Visual Studio CodeSpaces and Jira to support productivity. In contrast, within academia, students have focused on having face to face meetings for team communication and communication tools for file sharing. Due to the COVID 19 pandemic, universities have been forced to switch to an online or hybrid modality abruptly, thus compelling SE students to quickly adopt communication software. This paper proposes a study on the use of communication software in industry to prepare students for remote software development positions after graduation.


On the Unreasonable Effectiveness of Centroids in Image Retrieval. Image retrieval task consists of finding similar images to a query image from a set of gallery (database) images. Such systems are used in various applications e.g. person re identification (ReID) or visual product search. Despite active development of retrieval models it still remains a challenging task mainly due to large intra class variance caused by changes in view angle, lighting, background clutter or occlusion, while inter class variance may be relatively low. A large portion of current research focuses on creating more robust features and modifying objective functions, usually based on Triplet Loss. Some works experiment with using centroid proxy representation of a class to alleviate problems with computing speed and hard samples mining used with Triplet Loss. However, these approaches are used for training alone and discarded during the retrieval stage. In this paper we propose to use the mean centroid representation both during training and retrieval. Such an aggregated representation is more robust to outliers and assures more stable features. As each class is represented by a single embedding the class centroid both retrieval time and storage requirements are reduced significantly. Aggregating multiple embeddings results in a significant reduction of the search space due to lowering the number of candidate target vectors, which makes the method especially suitable for production deployments. Comprehensive experiments conducted on two ReID and Fashion Retrieval datasets demonstrate effectiveness of our method, which outperforms the current state of the art. We propose centroid training and retrieval as a viable method for both Fashion Retrieval and ReID applications.


Aiding Long Term Investment Decisions with XGBoost Machine Learning Model. The ability to identify stock market trends has obvious advantages for investors. Buying stock on an upward trend (as well as selling it in case of downward movement) results in profit. Accordingly, the start and end points of the trend are the optimal points for entering and leaving the market. The research concentrates on recognizing stock market long term upward and downward trends. The key results are obtained with the use of gradient boosting algorithms, XGBoost in particular. The raw data is represented by time series with basic stock market quotes with periods labelled by experts as Trend or Flat. The features are then obtained via various data transformations, aiming to catch implicit factors resulting in a change of stock direction. Modelling is done in two stages stage one aims to detect endpoints of tendencies (i.e. sliding windows), stage two recognizes the tendency itself inside the window. The research addresses such issues as imbalanced datasets and contradicting labels, as well as the need for specific quality metrics to keep up with practical applicability. The model can be used to design an investment strategy though further research in feature engineering and fine calibration is required.This paper is the full text of the research, presented at the 20th International Conference on Artificial Intelligence and Soft Computing Web System (ICAISC 2021)


Noisy Truncated SGD Optimization and Generalization. Recent empirical work on stochastic gradient descent (SGD) applied to over parameterized deep learning has shown that most gradient components over epochs are quite small. Inspired by such observations, we rigorously study properties of Truncated SGD (T SGD), that truncates the majority of small gradient components to zeros. Considering non convex optimization problems, we show that the convergence rate of T SGD matches the order of vanilla SGD. We also establish the generalization error bound for T SGD. Further, we propose Noisy Truncated SGD (NT SGD), which adds Gaussian noise to the truncated gradients. We prove that NT SGD has the same convergence rate as T SGD for non convex optimization problems. We demonstrate that with the help of noise, NT SGD can provably escape from saddle points and requires less noise compared to previous related work. We also prove that NT SGD achieves better generalization error bound compared to T SGD because of the noise. Our generalization analysis is based on uniform stability and we show that additional noise in the gradient update can boost the stability. Our experiments on a variety of benchmark datasets (MNIST, Fashion MNIST, CIFAR 10, and CIFAR 100) with various networks (VGG and ResNet) validate the theoretical properties of NT SGD, i.e., NT SGD matches the speed and accuracy of vanilla SGD while effectively working with sparse gradients, and can successfully escape poor local minima.


Further improvements of generalized numerical radius inequalities for Hilbert space operators. Several new improvements of the A numerical radius inequalities for operators acting on a semi Hilbert space, i.e., a space generated by a positive operator A , are proved. In particular, among other inequalities, we show that begin align frac 1 4 T sharp A T TT sharp A A leq frac 1 4 Big(2 omega A 2(T) gamma(T) Big) leq omega A 2(T), end align where gamma(T) sqrt left( Re A(T) A 2 Im A(T) A 2 right) 2 4 Re A(T) Im A(T) A 2 . Here omega A(X) and X A denote respectively the A numerical radius and the A seminorm of an operator X . Also, Re A(T) frac T T sharp A 2 and Im A(T) frac T T sharp A 2i , where T sharp A is a distinguished A adjoint operator of T . Further, some new refinements of the triangle inequality related to cdot A are established.


Conforming finite element DIVDIV complexes and the application for the linearized Einstein Bianchi system. This paper presents the first family of conforming finite element divdiv complexes on tetrahedral grids in three dimensions. In these complexes, finite element spaces of H( text divdiv , Omega mathbb S ) are from a current preprint Chen and Huang, arXiv 2007.12399, 2020 while finite element spaces of both H( text symcurl , Omega mathbb T ) and H 1( Omega mathbb R 3) are newly constructed here. It is proved that these finite element complexes are exact. As a result, they can be used to discretize the linearized Einstein Bianchi system within the dual formulation.


Checking Robustness Between Weak Transactional Consistency Models. Concurrent accesses to databases are typically encapsulated in transactions in order to enable isolation from other concurrent computations and resilience to failures. Modern databases provide transactions with various semantics corresponding to different trade offs between consistency and availability. Since a weaker consistency model provides better performance, an important issue is investigating the weakest level of consistency needed by a given program (to satisfy its specification). As a way of dealing with this issue, we investigate the problem of checking whether a given program has the same set of behaviors when replacing a consistency model with a weaker one. This property known as robustness generally implies that any specification of the program is preserved when weakening the consistency. We focus on the robustness problem for consistency models which are weaker than standard serializability, namely, causal consistency, prefix consistency, and snapshot isolation. We show that checking robustness between these models is polynomial time reducible to a state reachability problem under serializability. We use this reduction to also derive a pragmatic proof technique based on Lipton's reduction theory that allows to prove programs robust. We have applied our techniques to several challenging applications drawn from the literature of distributed systems and databases.


Smart Name Lookup for NDN Forwarding Plane via Neural Networks. Name lookup is a key technology for the forwarding plane of content router in Named Data Networking (NDN). To realize the efficient name lookup, what counts is deploying a highperformance index in content routers. So far, the proposed indexes have shown good performance, most of which are optimized for or evaluated with URLs collected from the current Internet, as the large scale NDN names are not available yet. Unfortunately, the performance of these indexes is always impacted in terms of lookup speed, memory consumption and false positive probability, as the distributions of URLs retrieved in memory may differ from those of real NDN names independently generated by content centric applications online. Focusing on this gap, a smart mapping model named Pyramid NN via neural networks is proposed to build an index called LNI for NDN forwarding plane. Through learning the distributions of the names retrieved in the static memory, LNI can not only reduce the memory consumption and the probability of false positive, but also ensure the performance of real NDN name lookup. Experimental results show that LNI based FIB can reduce the memory consumption to 58.258 MB for 2 million names. Moreover, as it can be deployed on SRAMs, the throughput is about 177 MSPS, which well meets the current network requirement for fast packet processing.


Neural Multi Hop Reasoning With Logical Rules on Biomedical Knowledge Graphs. Biomedical knowledge graphs permit an integrative computational approach to reasoning about biological systems. The nature of biological data leads to a graph structure that differs from those typically encountered in benchmarking datasets. To understand the implications this may have on the performance of reasoning algorithms, we conduct an empirical study based on the real world task of drug repurposing. We formulate this task as a link prediction problem where both compounds and diseases correspond to entities in a knowledge graph. To overcome apparent weaknesses of existing algorithms, we propose a new method, PoLo, that combines policy guided walks based on reinforcement learning with logical rules. These rules are integrated into the algorithm by using a novel reward function. We apply our method to Hetionet, which integrates biomedical information from 29 prominent bioinformatics databases. Our experiments show that our approach outperforms several state of the art methods for link prediction while providing interpretability.


A reduced order modeling framework for simulating signatures of faults in a bladed disk. This paper reports a reduced order modeling framework of bladed disks on a rotating shaft to simulate the vibration signature of faults like cracks in different components aiming towards simulated data driven machine learning. We have employed lumped and one dimensional analytical models of the subcomponents for better insight into the complex dynamic response. The framework seeks to address some of the challenges encountered in analyzing and optimizing fault detection and identification schemes for health monitoring of rotating turbomachinery, including aero engines. We model the bladed disks and shafts by combining lumped elements and one dimensional finite elements, leading to a coupled system. The simulation results are in good agreement with previously published data. We model the cracks in a blade analytically with their effective reduced stiffness approximation. Multiple types of faults are modeled, including cracks in the blades of single and two stage bladed disks, Fan Blade Off (FBO), and Foreign Object Damage (FOD). We have applied aero engine operational loading conditions to simulate realistic scenarios of online health monitoring. The proposed reduced order simulation framework will have applications in probabilistic signal modeling, machine learning toward fault signature identification, and parameter estimation with measured vibration signals.


Deep Graph level Anomaly Detection by Glocal Knowledge Distillation. Graph level anomaly detection (GAD) describes the problem of detecting graphs that are abnormal in their structure and or the features of their nodes, as compared to other graphs. One of the challenges in GAD is to devise graph representations that enable the detection of both locally and globally anomalous graphs, i.e., graphs that are abnormal in their fine grained (node level) or holistic (graph level) properties, respectively. To tackle this challenge we introduce a novel deep anomaly detection approach for GAD that learns rich global and local normal pattern information by joint random distillation of graph and node representations. The random distillation is achieved by training one GNN to predict another GNN with randomly initialized network weights. Extensive experiments on 16 real world graph datasets from diverse domains show that our model significantly outperforms seven state of the art models. Code and datasets are available at https git.io GLocalKD.


The emergence of visual semantics through communication games. The emergence of communication systems between agents which learn to play referential signalling games with realistic images has attracted a lot of attention recently. The majority of work has focused on using fixed, pretrained image feature extraction networks which potentially bias the information the agents learn to communicate. In this work, we consider a signalling game setting in which a sender' agent must communicate the information about an image to a receiver' who must select the correct image from many distractors. We investigate the effect of the feature extractor's weights and of the task being solved on the visual semantics learned by the models. We first demonstrate to what extent the use of pretrained feature extraction networks inductively bias the visual semantics conveyed by emergent communication channel and quantify the visual semantics that are induced. We then go on to explore ways in which inductive biases can be introduced to encourage the emergence of semantically meaningful communication without the need for any form of supervised pretraining of the visual feature extractor. We impose various augmentations to the input images and additional tasks in the game with the aim to induce visual representations which capture conceptual properties of images. Through our experiments, we demonstrate that communication systems which capture visual semantics can be learned in a completely self supervised manner by playing the right types of game. Our work bridges a gap between emergent communication research and self supervised feature learning.


A Neuronal Noise Critique of Integrated Information Theory. Integrated Information Theory (IIT) is an audacious attempt to pin down the abstract, phenomenological experiences of consciousness into a rigorous, mathematical framework. We show that IIT's stance in regards to neuronal noise is inconsistent with experimental data demonstrating that neuronal noise in the brain plays a critical role in learning, visual recognition, and even categorical representation. IIT predicts that entropy due to noise will reduce the information integration of a physical system, which is inconsistent with experimental data demonstrating that decision related noise is a necessary condition for learning and visual recognition tasks. IIT must therefore be reformulated to accommodate experimental evidence showing both the successes and failures of noise.


Graphics processing unit accelerated lattice Boltzmann method simulations of dilute gravity currents. Lattice Boltzmann method models offer a novel framework for the simulation of high Reynolds number dilute gravity currents. The numerical algorithm is well suited to acceleration via implementation on massively parallel computer architectures. Here we present two lattice Boltzmann method models of lock exchange dilute gravity currents, in which the largest turbulent length scales are directly resolved. The three dimensional simulations are accelerated by exporting computations to a graphics processing unit and are validated against experiments and high resolution simulations for Reynolds numbers up to 30,000. The lattice Boltzmann method models achieve equivalent accuracy to conventional large eddy simulation models in the prediction of key flow properties. A conservative analysis of computational performance relative to conventional methods indicates that the presented framework reduces simulation times by two orders of magnitude. Therefore, it can be used as a foundation for the development of depth resolving models that capture more of the complexity of environmental gravity currents.


Statistical CSI Based Hybrid mmWave MIMO NOMA with Max Min Fairness. Non orthogonal multiple access (NOMA) and millimeter wave (mmWave) are two key enabling technologies for the fifth generation (5G) mobile networks and beyond. In this paper, we consider mmWave NOMA systems with max min fairness constraints. On the one hand, existing beamforming designs aiming at maximizing the spectrum efficiency (SE) are unsuitable for the NOMA systems with fairness in this paper. On the other hand, previous work on about mmWave NOMA mostly depends on full knowledge of channel state information (CSI) which is extremely difficult to obtain accurately in mmWave communication systems. To address this problem, we propose a heuristic hybrid beamforming design based on the statistical CSI (SCSI) user grouping strategy. An analog beamforming scheme is first proposed to integrate the whole cluster users to mitigate the inter cluster interference in the first stage. Then two digital beamforming designs are proposed to further suppress the interference based on SCSI. One is the widely used zero forcing (ZF) approach and the other is derived from the signal to leakage plus noise ratio (SLNR) metric extended from orthogonal multiple access (OMA) systems. The effective gains fed back from the users are used for the power allocation. We introduce the quadratic transform (QT) method and bisection approach to reformulate this complex problem so as to rend it solvable. Simulation results show that our proposed algorithms outperform the previous algorithms in term of user fairness.


Pursuing Stacks. Pursuing Stacks ( A la poursuite des Champs) First episode The modelizing story (histoire de mod eles) by Alexander Grothendieck. Grothendieck began writing Pursuing stacks under the influence of some letters of the beginning of 1983 that motivates him to write to Daniel Quillen as a Take off, adding some letters to Lawrence Breen as an appendix and outline of the program, of a systematic reflection on the foundations of non commutative (co)homological algebra and its coefficients, and of homotopical algebra. The text is written in English as it grew out of the correspondence with R Brown and D Quillen. The title is based on the intuition that stacks are the unifying concept for a synthesis of homotopical algebra and non commutative cohomological algebra. The first episode called "The modelizing story" is a comprehensive reflection about foundational matters in homotopy theory, and just after the beginning, the reflection diverged from stacks and rather centers itself around understanding the manifold ways of modeling homotopy categories. Grothendieck continued the reflection until November of the same year. In June he writes the first words of the introduction and retakes it in February of 1984 when the reflection has ended months ago (meanwhile he reflects on pseudo lines and writes "L'Esquisse d'un Programme"). This introduction begins to take a more personal air and then he moves to French. The months that follow see the beginning of "R 'ecoltes et Semailles". The whole project would be included in a volume of the "R 'eflexions math 'ematiques", but the whole series never saw the light. The 2015 edition by "thescrivener" is in the public domain. This edition is an extended and revised version by Mateo Carmona with the collaboration of Ulrik Buchholtz.


Learning Geometry Guided Depth via Projective Modeling for Monocular 3D Object Detection. As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth estimation. Most existing monocular methods typically directly regress the scene depth while ignoring important relationships between the depth and various geometric elements (e.g. bounding box sizes, 3D object dimensions, and object poses). In this paper, we propose to learn geometry guided depth estimation with projective modeling to advance monocular 3D object detection. Specifically, a principled geometry formula with projective modeling of 2D and 3D depth predictions in the monocular 3D object detection network is devised. We further implement and embed the proposed formula to enable geometry aware deep representation learning, allowing effective 2D and 3D interactions for boosting the depth estimation. Moreover, we provide a strong baseline through addressing substantial misalignment between 2D annotation and projected boxes to ensure robust learning with the proposed geometric formula. Experiments on the KITTI dataset show that our method remarkably improves the detection performance of the state of the art monocular based method without extra data by 2.80 on the moderate test setting. The model and code will be released at https github.com YinminZhang MonoGeo.


Segmenting Subtitles for Correcting ASR Segmentation Errors. Typical ASR systems segment the input audio into utterances using purely acoustic information, which may not resemble the sentence like units that are expected by conventional machine translation (MT) systems for Spoken Language Translation. In this work, we propose a model for correcting the acoustic segmentation of ASR models for low resource languages to improve performance on downstream tasks. We propose the use of subtitles as a proxy dataset for correcting ASR acoustic segmentation, creating synthetic acoustic utterances by modeling common error modes. We train a neural tagging model for correcting ASR acoustic segmentation and show that it improves downstream performance on MT and audio document cross language information retrieval (CLIR).


Robust Flight Control of a Small Unmanned Helicopter. This paper addresses the design and application controller for a small size unmanned aerial vehicle (UAV). In this work, the main objective is to study the modeling and attitude controller design for a small size helicopter. Based on a non simplified helicopter model, a new robust attitude control law, which is combined with a nonlinear control method and a model free method, is proposed in this paper. Both wind gust and ground effect phenomena conditions are involved in this experiment and the result on a real helicopter platform demonstrates the effectiveness of the proposed control algorithm and robustness of its resultant controller.


New efficient time stepping schemes for the anisotropic phase field dendritic crystal growth model. In this paper, we propose and analyze a first order and a second order time stepping schemes for the anisotropic phase field dendritic crystal growth model. The proposed schemes are based on an auxiliary variable approach for the Allen Cahn equation and delicate treatment of the terms coupling the Allen Cahn equation and temperature equation. The idea of the former is to introduce suitable auxiliary variables to facilitate construction of high order stable schemes for a large class of gradient flows. We propose a new technique to treat the coupling terms involved in the crystal growth model and introduce suitable stabilization terms to result in totally decoupled schemes, which satisfy a discrete energy law without affecting the convergence order. A delicate implementation demonstrates that the proposed schemes can be realized in a very efficient way. That is, it only requires solving four linear elliptic equations and a simple algebraic equation at each time step. A detailed comparison with existing schemes is given, and the advantage of the new schemes are emphasized. As far as we know this is the first second order scheme that is totally decoupled, linear, unconditionally stable for the dendritic crystal growth model with variable mobility parameter.


SpecMix A Mixed Sample Data Augmentation method for Training withTime Frequency Domain Features. A mixed sample data augmentation strategy is proposed to enhance the performance of models on audio scene classification, sound event classification, and speech enhancement tasks. While there have been several augmentation methods shown to be effective in improving image classification performance, their efficacy toward time frequency domain features of audio is not assured. We propose a novel audio data augmentation approach named "Specmix" specifically designed for dealing with time frequency domain features. The augmentation method consists of mixing two different data samples by applying time frequency masks effective in preserving the spectral correlation of each audio sample. Our experiments on acoustic scene classification, sound event classification, and speech enhancement tasks show that the proposed Specmix improves the performance of various neural network architectures by a maximum of 2.7 .


Doubly Exponential Identification via Channels Code Constructions and Bounds. Consider the identification (ID) via channels problem, where a receiver wants to decide whether the transmitted identifier is its identifier, rather than decoding the identifier. This model allows to transmit identifiers whose size scales doubly exponentially in the blocklength, unlike common transmission (or channel) codes whose size scales exponentially. It suffices to use binary constant weight codes (CWCs) to achieve the ID capacity. By relating the parameters of a binary CWC to the minimum distance of a code and using higher order correlation moments, two upper bounds on the binary CWC size are proposed. These bounds are shown to be upper bounds also on the identifier sizes for ID codes constructed by using binary CWCs. We propose two code constructions based on optical orthogonal codes, which are used in optical multiple access schemes, have constant weight codewords, and satisfy cyclic cross correlation and auto correlation constraints. These constructions are modified and concatenated with outer Reed Solomon codes to propose new binary CWCs optimal for ID. Improvements to the finite parameter performance of both our and existing code constructions are shown by using outer codes with larger minimum distance vs. blocklength ratios. We also illustrate ID performance regimes for which our ID code constructions perform significantly better than existing constructions.


Compactness for Omega Yang Mills connections. On a Riemannian manifold of dimension n we extend the known analytic results on Yang Mills connections to the class of connections called Omega Yang Mills connections, where Omega is a smooth, not necessarily closed, (n 4) form. Special cases include Omega anti self dual connections and Hermitian Yang Mills connections over general complex manifolds. By a key observation, a weak compactness result is obtained for moduli space of smooth Omega Yang Mills connections with uniformly L 2 bounded curvature, and it can be improved in the case of Hermitian Yang Mills connections over general complex manifolds. A removable singularity theorem for singular Omega Yang Mills connections on a trivial bundle with small energy concentration is also proven. As an application, it is shown how to compactify the moduli space of smooth Hermitian Yang Mills connections on unitary bundles over a class of balanced manifolds of Hodge Riemann type. This class includes the metrics coming from multipolarizations, and in particular, the Kaehler metrics. In the case of multipolarizations on a projective algebraic manifold, the compactification of smooth irreducible Hermitian Yang Mills connections with fixed determinant modulo gauge transformations inherits a complex structure from algebro geometric considerations.


The Pollution Routing Problem with Speed Optimization and Uneven Topography. This paper considers a joint pollution routing and speed optimization problem (PRP SO) where fuel costs and textit CO 2e emissions depend on the vehicle speed, arc payloads, and road grades. We present two methods, one approximate and one exact, for solving the PRP SO. The approximate strategy solves large scale instances of the problem with a tabu search based metaheuristic coupled with an efficient fixed sequence speed optimization algorithm. The second strategy consists of a tailored branch and price (BP) algorithm in which speed optimization is managed within the pricing problem. We test both methods on modified Solomon benchmarks and newly constructed real life instance sets. Our BP algorithm solves most instances with up to 50 customers and many instances with 75 and 100 customers. The heuristic is able to find near optimal solutions to all instances and requires less than one minute of computational time per instance. Results on real world instances suggest several managerial insights. First, fuel savings of up to 53 are realized when explicitly taking into account arc payloads and road grades. Second, fuel savings and emissions reduction are also achieved by scheduling uphill customers later along the routes. Lastly, we show that ignoring elevation information when planning routes leads to highly inaccurate fuel consumption estimates.


CoreUI Interactive Core Training System with 3D Human Shape. We present an interactive core training system for core training using a monocular camera image as input in this paper. It is commonly expensive to capture human pose using depth cameras or multiple cameras with conventional approaches. To solve this issue, we employ the skinned multi person linear model of human shape to recover the 3D human pose from 2D images using pose estimation and human mesh recovery approaches. In order to support the user in maintaining the correct postures from target poses in the training, we adopt 3D human shape estimation for both the target image and input camera video. We propose CoreUI, a user interface for providing visual guidance showing the differences among the estimated targets and current human shapes in core training, which are visualized by markers at ten body parts with color changes. From our user studies, the proposed core training system is effective and convenient compared with the conventional guidance of 2D skeletons.


Opinion formation on social networks with algorithmic bias Dynamics and bias imbalance. We investigate opinion dynamics and information spreading on networks under the influence of content filtering technologies. The filtering mechanism, present in many online social platforms, reduces individuals' exposure to disagreeing opinions, producing algorithmic bias. We derive evolution equations for global opinion variables in the presence of algorithmic bias, network community structure, noise (independent behavior of individuals), and pairwise or group interactions. We consider the case where the social platform shows a predilection for one opinion over its opposite, unbalancing the dynamics in favor of that opinion. We show that if the imbalance is strong enough, it may determine the final global opinion and the dynamical behavior of the population. We find a complex phase diagram including phases of coexistence, consensus, and polarization of opinions as possible final states of the model, with phase transitions of different order between them. The fixed point structure of the equations determines the dynamics to a large extent. We focus on the time needed for convergence and conclude that this quantity varies within a wide range, showing occasionally signatures of critical slowing down and meta stability.


All You Need is DAG. We present DAG Rider, the first asynchronous Byzantine Atomic Broadcast protocol that achieves optimal resilience, optimal amortized communication complexity, and optimal time complexity. DAG Rider is post quantum safe and ensures that all messages proposed by correct processes eventually get decided. We construct DAG Rider in two layers In the first layer, processes reliably broadcast their proposals and build a structured Directed Acyclic Graph (DAG) of the communication among them. In the second layer, processes locally observe their DAGs and totally order all proposals with no extra communication.


Delphi Towards Machine Ethics and Norms. What would it take to teach a machine to behave ethically? While broad ethical rules may seem straightforward to state ("thou shalt not kill"), applying such rules to real world situations is far more complex. For example, while "helping a friend" is generally a good thing to do, "helping a friend spread fake news" is not. We identify four underlying challenges towards machine ethics and norms (1) an understanding of moral precepts and social norms (2) the ability to perceive real world situations visually or by reading natural language descriptions (3) commonsense reasoning to anticipate the outcome of alternative actions in different contexts (4) most importantly, the ability to make ethical judgments given the interplay between competing values and their grounding in different contexts (e.g., the right to freedom of expression vs. preventing the spread of fake news). Our paper begins to address these questions within the deep learning paradigm. Our prototype model, Delphi, demonstrates strong promise of language based commonsense moral reasoning, with up to 92.1 accuracy vetted by humans. This is in stark contrast to the zero shot performance of GPT 3 of 52.3 , which suggests that massive scale alone does not endow pre trained neural language models with human values. Thus, we present Commonsense Norm Bank, a moral textbook customized for machines, which compiles 1.7M examples of people's ethical judgments on a broad spectrum of everyday situations. In addition to the new resources and baseline performances for future research, our study provides new insights that lead to several important open research questions differentiating between universal human values and personal values, modeling different moral frameworks, and explainable, consistent approaches to machine ethics.


Acoustic based Object Detection for Pedestrian Using Smartphone. Walking while using a smartphone is becoming a major pedestrian safety concern as people may unknowingly bump into various obstacles that could lead to severe injuries. In this paper, we propose ObstacleWatch, an acoustic based obstacle collision detection system to improve the safety of pedestrians who are engaged in smartphone usage while walking. ObstacleWatch leverages the advanced audio hardware of the smartphone to sense the surrounding obstacles and infers fine grained information about the frontal obstacle for collision detection. In particular, our system emits well designed inaudible beep signals from the smartphone built in speaker and listens to the reflections with the stereo recording of the smartphone. By analyzing the reflected signals received at two microphones, ObstacleWatch is able to extract fine grained information of the frontal obstacle including the distance, angle, and size for detecting the possible collisions and to alert users. Our experimental evaluation under two real world environments with different types of phones and obstacles shows that ObstacleWatch achieves over 92 accuracy in predicting obstacle collisions with distance estimation errors at about 2 cm. Results also show that ObstacleWatch is robust to different sizes of objects and is compatible with different phone models with low energy consumption.


A General Convex Integration Scheme for the Isentropic Compressible Euler Equations. We prove via convex integration a result that allows to pass from a so called subsolution of the isentropic Euler equations (in space dimension at least 2 ) to exact weak solutions. The method is closely related to the incompressible scheme established by De Lellis Sz 'ekelyhidi, in particular we only perturb momenta and not densities. Surprisingly, though, this turns out not to be a restriction, as can be seen from our simple characterization of the Lambda convex hull of the constitutive set. An important application of our scheme will be exhibited in forthcoming work by Gallenm "uller Wiedemann.


Deep neural networks based denoising models for CT imaging and their efficacy. Most of the Deep Neural Networks (DNNs) based CT image denoising literature shows that DNNs outperform traditional iterative methods in terms of metrics such as the RMSE, the PSNR and the SSIM. In many instances, using the same metrics, the DNN results from low dose inputs are also shown to be comparable to their high dose counterparts. However, these metrics do not reveal if the DNN results preserve the visibility of subtle lesions or if they alter the CT image properties such as the noise texture. Accordingly, in this work, we seek to examine the image quality of the DNN results from a holistic viewpoint for low dose CT image denoising. First, we build a library of advanced DNN denoising architectures. This library is comprised of denoising architectures such as the DnCNN, U Net, Red Net, GAN, etc. Next, each network is modeled, as well as trained, such that it yields its best performance in terms of the PSNR and SSIM. As such, data inputs (e.g. training patch size, reconstruction kernel) and numeric optimizer inputs (e.g. minibatch size, learning rate, loss function) are accordingly tuned. Finally, outputs from thus trained networks are further subjected to a series of CT bench testing metrics such as the contrast dependent MTF, the NPS and the HU accuracy. These metrics are employed to perform a more nuanced study of the resolution of the DNN outputs' low contrast features, their noise textures, and their CT number accuracy to better understand the impact each DNN algorithm has on these underlying attributes of image quality.


Explanation by Automated Reasoning Using the Isabelle Infrastructure Framework. In this paper, we propose the use of interactive theorem proving for explainable machine learning. After presenting our proposition, we illustrate it on the dedicated application of explaining security attacks using the Isabelle Infrastructure framework and its process of dependability engineering. This formal framework and process provides the logics for specification and modeling. Attacks on security of the system are explained by specification and proofs in the Isabelle Infrastructure framework. Existing case studies of dependability engineering in Isabelle are used as feasibility studies to illustrate how different aspects of explanations are covered by the Isabelle Infrastructure framework.


Semantics Recovering Decompilation through Neural Machine Translation. Decompilation transforms low level program languages (PL) (e.g., binary code) into high level PLs (e.g., C C ). It has been widely used when analysts perform security analysis on software (systems) whose source code is unavailable, such as vulnerability search and malware analysis. However, current decompilation tools usually need lots of experts' efforts, even for years, to generate the rules for decompilation, which also requires long term maintenance as the syntax of high level PL or low level PL changes. Also, an ideal decompiler should concisely generate high level PL with similar functionality to the source low level PL and semantic information (e.g., meaningful variable names), just like human written code. Unfortunately, existing manually defined rule based decompilation techniques only functionally restore the low level PL to a similar high level PL and are still powerless to recover semantic information. In this paper, we propose a novel neural decompilation approach to translate low level PL into accurate and user friendly high level PL, effectively improving its readability and understandability. Furthermore, we implement the proposed approaches called SEAM. Evaluations on four real world applications show that SEAM has an average accuracy of 94.41 , which is much better than prior neural machine translation (NMT) models. Finally, we evaluate the effectiveness of semantic information recovery through a questionnaire survey, and the average accuracy is 92.64 , which is comparable or superior to the state of the art compilers.


Eye Program Visualizer for CS2. In recent years, programming has witnessed a shift towards using standard libraries as a black box. However, there has not been a synchronous development of tools that can help demonstrate the working of such libraries in general programs, which poses an impediment to improved learning outcomes and makes debugging exasperating. We introduce Eye, an interactive pedagogical tool that visualizes a program's execution as it runs. It demonstrates properties and usage of data structures in a general environment, thereby helping in learning, logical debugging, and code comprehension. Eye provides a comprehensive overview at each stage during run time including the execution stack and the state of data structures. The modular implementation allows for extension to other languages and modification of the graphics as desired. Eye opens up a gateway for CS2 students to more easily understand myriads of programs that are available on online programming websites, lowering the barrier towards self learning of coding. It expands the scope of visualizing data structures from standard algorithms to general cases, benefiting both teachers as well as programmers who face issues in debugging. Line by line interpreting allows Eye to describe the execution and not only the current state. We also conduct experiments to evaluate the efficacy of Eye for debugging and comprehending a new piece of code. Our findings show that it becomes faster and less frustrating to debug certain problems using this tool, and also makes understanding new code a much more pleasant experience.


Formal aspects on parametrized topological complexity and its pointed version. The notion of parametrized topological complexity, introduced by Cohen, Farber and Weinberger, is extended to fibrewise spaces which are not necessarily Hurewicz fibrations. After exploring some formal properties of this extension we also introduce the pointed version of parametrized topological complexity. Finally we give sufficient conditions so that both notions agree.


Joint Representation Learning and Novel Category Discovery on Single and Multi modal Data. This paper studies the problem of novel category discovery on single and multi modal data with labels from different but relevant categories. We present a generic, end to end framework to jointly learn a reliable representation and assign clusters to unlabelled data. To avoid over fitting the learnt embedding to labelled data, we take inspiration from self supervised representation learning by noise contrastive estimation and extend it to jointly handle labelled and unlabelled data. In particular, we propose using category discrimination on labelled data and cross modal discrimination on multi modal data to augment instance discrimination used in conventional contrastive learning approaches. We further employ Winner Take All (WTA) hashing algorithm on the shared representation space to generate pairwise pseudo labels for unlabelled data to better predict cluster assignments. We thoroughly evaluate our framework on large scale multi modal video benchmarks Kinetics 400 and VGG Sound, and image benchmarks CIFAR10, CIFAR100 and ImageNet, obtaining state of the art results.