MIMO Transmission Under Discrete Input Signal Constraints. In this paper, we propose a multiple input multipleoutput (MIMO) transmission strategy that is closer to the Shannon limit than the existing strategies. Different from most existing strategies which only consider uniformly distributed discrete input signals, we present a unified framework to optimize the MIMO precoder and the discrete input signal distribution jointly. First, a general model of MIMO transmission under discrete input signals and its equivalent formulation are established. Next, in order to maximize the mutual information between the input and output signals, we provide an algorithm that jointly optimizes the precoder and the input distribution. Finally, we compare our strategy with other existing strategies in the simulation. Numerical results indicate that our strategy narrows the gap between the mutual information and Shannon limit, and shows a lower frame error rate in simulation.


Small data scattering of Dirac equations with Yukawa type potentials in L x 2( mathbb R 2) . We revisit the Cauchy problem of nonlinear massive Dirac equation with Yukawa type potentials mathcal F 1 left (b 2 xi 2) 1 right in 2 dimensions. The authors of cite tes2d, geosha obtained small data scattering and large data global well posedness in H s for s 0 , respectively. In this paper we show that the small data scattering occurs in L x 2( mathbb R 2) . This can be done by combining bilinear estimates and modulation estimates of cite yang, tes2d .


Impact of Culture on the Adoption of Diabetes Self Management Applications Cape Flats, South Africa. Diabetes is a global health problem with a high mortality rate. The research indicates low levels of technology use amongst diabetic patients in low socioeconomic environments and minority groups. We posit that the culture of patients is a potential reason for the low adoption and use of technology. However, research on the proliferation of culture at an individual level is limited. Therefore, this paper assessed the influence of culture on mobile application adoption and use amongst diabetic patients in the Cape Flats, South Africa. This study used key constructs from the Theory of Planned Behaviour (TPB) and Hofstede's cultural dimensions. It was analysed using survey data from 439 respondents using purposive sampling. It was found that the dimensions of Hofstede and the Theory of Planned Behaviour can identify how culture influences mobile application adoption of diabetic patients in the geographical Cape Flats area. However, this research indicates a stronger relationship between culture and diabetes self management activities than culture and the adoption of mobile applications.


Cardiac Motion Modeling with Parallel Transport and Shape Splines. In cases of pressure or volume overload, probing cardiac function may be difficult because of the interactions between shape and deformations.In this work, we use the LDDMM framework and parallel transport to estimate and reorient deformations of the right ventricle. We then propose a normalization procedure for the amplitude of the deformation, and a second order spline model to represent the full cardiac contraction. The method is applied to 3D meshes of the right ventricle extracted from echocardiographic sequences of 314 patients divided into three disease categories and a control group. We find significant differences between pathologies in the model parameters, revealing insights into the dynamics of each disease.


On Regularized Square root Regression Problems Distributionally Robust Interpretation and Fast Computations. Square root (loss) regularized models have recently become popular in linear regression due to their nice statistical properties. Moreover, some of these models can be interpreted as the distributionally robust optimization counterparts of the traditional least squares regularized models. In this paper, we give a unified proof to show that any square root regularized model whose penalty function being the sum of a simple norm and a seminorm can be interpreted as the distributionally robust optimization (DRO) formulation of the corresponding least squares problem. In particular, the optimal transport cost in the DRO formulation is given by a certain dual form of the penalty. To solve the resulting square root regularized model whose loss function and penalty function are both nonsmooth, we design a proximal point dual semismooth Newton algorithm and demonstrate its efficiency when the penalty is the sparse group Lasso penalty or the fused Lasso penalty. Extensive experiments demonstrate that our algorithm is highly efficient for solving the square root sparse group Lasso problems and the square root fused Lasso problems.


Self restrained Triplet Loss for Accurate Masked Face Recognition. Using the face as a biometric identity trait is motivated by the contactless nature of the capture process and the high accuracy of the recognition algorithms. After the current COVID 19 pandemic, wearing a face mask has been imposed in public places to keep the pandemic under control. However, face occlusion due to wearing a mask presents an emerging challenge for face recognition systems. In this paper, we present a solution to improve masked face recognition performance. Specifically, we propose the Embedding Unmasking Model (EUM) operated on top of existing face recognition models. We also propose a novel loss function, the Self restrained Triplet (SRT), which enabled the EUM to produce embeddings similar to these of unmasked faces of the same identities. The achieved evaluation results on three face recognition models, two real masked datasets, and two synthetically generated masked face datasets proved that our proposed approach significantly improves the performance in most experimental settings.


Continuous state branching processes with spectrally positive migration. Continuous state branching processes (CSBPs) with immigration (CBIs), stopped on hitting zero, are generalized by allowing the process governing immigration to be any L 'evy process without negative jumps. Unlike the CBIs, these newly introduced processes do not appear to satisfy any natural affine property on the level of the Laplace transforms of the semigroups. Basic properties are noted. Explicit formulae (on neighborhoods of infinity) for the Laplace transforms of the first passage times downwards and of the explosion time are derived.


Active Modular Environment for Robot Navigation. This paper presents a novel robot environment interaction in navigation tasks such that robots have neither a representation of their working space nor planning function, instead, an active environment takes charge of these aspects. This is realized by spatially deploying computing units, called cells, and making cells manage traffic in their respective physical region. Different from stigmegic approaches, cells interact with each other to manage environmental information and to construct instructions on how robots move. As a proof of concept, we present an architecture called AFADA and its prototype, consisting of modular cells and robots moving on the cells. The instructions from cells are based on a distributed routing algorithm and a reservation protocol. We demonstrate that AFADA achieves efficient robot moves for single robot navigation in a dynamic environment changing its topology with a stochastic model, comparing to self navigation by a robot itself. This is followed by several demos, including multi robot navigation, highlighting the power of offloading both representation and planning from robots to the environment. We expect that the concept of AFADA contributes to developing the infrastructure for multiple robots because it can engage online and lifelong planning and execution.


Photozilla A Large Scale Photography Dataset and Visual Embedding for 20 Photography Styles. The advent of social media platforms has been a catalyst for the development of digital photography that engendered a boom in vision applications. With this motivation, we introduce a large scale dataset termed 'Photozilla', which includes over 990k images belonging to 10 different photographic styles. The dataset is then used to train 3 classification models to automatically classify the images into the relevant style which resulted in an accuracy of 96 . With the rapid evolution of digital photography, we have seen new types of photography styles emerging at an exponential rate. On that account, we present a novel Siamese based network that uses the trained classification models as the base architecture to adapt and classify unseen styles with only 25 training samples. We report an accuracy of over 68 for identifying 10 other distinct types of photography styles. This dataset can be found at https trisha025.github.io Photozilla


Challenges in Automated Debiasing for Toxic Language Detection. Biased associations have been a challenge in the development of classifiers for detecting toxic language, hindering both fairness and accuracy. As potential solutions, we investigate recently introduced debiasing methods for text classification datasets and models, as applied to toxic language detection. Our focus is on lexical (e.g., swear words, slurs, identity mentions) and dialectal markers (specifically African American English). Our comprehensive experiments establish that existing methods are limited in their ability to prevent biased behavior in current toxicity detectors. We then propose an automatic, dialect aware data correction method, as a proof of concept. Despite the use of synthetic labels, this method reduces dialectal associations with toxicity. Overall, our findings show that debiasing a model trained on biased toxic language data is not as effective as simply relabeling the data to remove existing biases.


A C 1 conforming Petrov Galerkin method for convection diffusion equations and superconvergence ananlysis over rectangular meshes. In this paper, a new C 1 conforming Petrov Galerkin method for convection diffusion equations is designed and analyzed. The trail space of the proposed method is a C 1 conforming mathbb Q k (i.e., tensor product of polynomials of degree at most k ) finite element space while the test space is taken as the L 2 (discontinuous) piecewise mathbb Q k 2 polynomial space. Existence and uniqueness of the numerical solution is proved and optimal error estimates in all L 2, H 1, H 2 norms are established. In addition, superconvergence properties of the new method are investigated and superconvergence points lines are identified at mesh nodes (with order 2k 2 for both function value and derivatives), at roots of a special Jacobi polynomial, and at the Lobatto lines and Gauss lines with rigorous theoretical analysis. In order to reduce the global regularity requirement, interior a priori error estimates in the L 2, H 1, H 2 norms are derived. Numerical experiments are presented to confirm theoretical findings.


Multi person Implicit Reconstruction from a Single Image. We present a new end to end learning framework to obtain detailed and spatially coherent reconstructions of multiple people from a single image. Existing multi person methods suffer from two main drawbacks they are often model based and therefore cannot capture accurate 3D models of people with loose clothing and hair or they require manual intervention to resolve occlusions or interactions. Our method addresses both limitations by introducing the first end to end learning approach to perform model free implicit reconstruction for realistic 3D capture of multiple clothed people in arbitrary poses (with occlusions) from a single image. Our network simultaneously estimates the 3D geometry of each person and their 6DOF spatial locations, to obtain a coherent multi human reconstruction. In addition, we introduce a new synthetic dataset that depicts images with a varying number of inter occluded humans and a variety of clothing and hair styles. We demonstrate robust, high resolution reconstructions on images of multiple humans with complex occlusions, loose clothing and a large variety of poses and scenes. Our quantitative evaluation on both synthetic and real world datasets demonstrates state of the art performance with significant improvements in the accuracy and completeness of the reconstructions over competing approaches.


Cocyclic braces and indecomposable cocyclic solutions of the Yang Baxter equation. We study indecomposable involutive set theoretic solutions of the Yang Baxter equation with cyclic permutation groups (cocyclic solutions). In particular, we show that there is no one to one correspondence between indecomposable cocyclic solutions and cocyclic braces which contradicts recent results in cite Rump21 .


Word2Pix Word to Pixel Cross Attention Transformer in Visual Grounding. Current one stage methods for visual grounding encode the language query as one holistic sentence embedding before fusion with visual feature. Such a formulation does not treat each word of a query sentence on par when modeling language to visual attention, therefore prone to neglect words which are less important for sentence embedding but critical for visual grounding. In this paper we propose Word2Pix a one stage visual grounding network based on encoder decoder transformer architecture that enables learning for textual to visual feature correspondence via word to pixel attention. The embedding of each word from the query sentence is treated alike by attending to visual pixels individually instead of single holistic sentence embedding. In this way, each word is given equivalent opportunity to adjust the language to vision attention towards the referent target through multiple stacks of transformer decoder layers. We conduct the experiments on RefCOCO, RefCOCO and RefCOCOg datasets and the proposed Word2Pix outperforms existing one stage methods by a notable margin. The results obtained also show that Word2Pix surpasses two stage visual grounding models, while at the same time keeping the merits of one stage paradigm namely end to end training and real time inference speed intact.


Structured Scene Memory for Vision Language Navigation. Recently, numerous algorithms have been developed to tackle the problem of vision language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply store their past experiences observations as latent states in recurrent networks, failing to capture environment layouts and make long term planning. To address these limitations, we propose a crucial architecture, called Structured Scene Memory (SSM). It is compartmentalized enough to accurately memorize the percepts during navigation. It also serves as a structured scene representation, which captures and disentangles visual and geometric cues in the environment. SSM has a collect read controller that adaptively collects information for supporting current decision making and mimics iterative algorithms for long range reasoning. As SSM provides a complete action space, i.e., all the navigable places on the map, a frontier exploration based navigation decision making strategy is introduced to enable efficient and global planning. Experiment results on two VLN datasets (i.e., R2R and R4R) show that our method achieves state of the art performance on several metrics.


Connecting lattice points and volume through successive minima. We study inequalities that simultaneously relate the number of lattice point, the volume and the successive minima of a convex body to one another. In particular, this leads to an upper bound on the lattice point enumerator in terms of the successive minima, which is equivalent to the classical Minkowski's Second Theorem on successive minima.


Planar graphs with the maximum number of induced 4 cycles or 5 cycles. For large n we determine exactly the maximum numbers of induced C 4 and C 5 subgraphs that a planar graph on n vertices can contain. We show that K 2,n 2 uniquely achieves this maximum in the C 4 case, and we identify the graphs which achieve the maximum in the C 5 case. This extends work in a paper by Hakimi and Schmeichel and a paper by Ghosh, Gy H o ri, Janzer, Paulos, Salia, and Zamora which together determine both maxima asymptotically.


Interpretable Propaganda Detection in News Articles. Online users today are exposed to misleading and propagandistic news articles and media posts on a daily basis. To counter thus, a number of approaches have been designed aiming to achieve a healthier and safer online news and media consumption. Automatic systems are able to support humans in detecting such content yet, a major impediment to their broad adoption is that besides being accurate, the decisions of such systems need also to be interpretable in order to be trusted and widely adopted by users. Since misleading and propagandistic content influences readers through the use of a number of deception techniques, we propose to detect and to show the use of such techniques as a way to offer interpretability. In particular, we define qualitatively descriptive features and we analyze their suitability for detecting deception techniques. We further show that our interpretable features can be easily combined with pre trained language models, yielding state of the art results.


Security Vulnerability Detection Using Deep Learning Natural Language Processing. Detecting security vulnerabilities in software before they are exploited has been a challenging problem for decades. Traditional code analysis methods have been proposed, but are often ineffective and inefficient. In this work, we model software vulnerability detection as a natural language processing (NLP) problem with source code treated as texts, and address the automated software venerability detection with recent advanced deep learning NLP models assisted by transfer learning on written English. For training and testing, we have preprocessed the NIST NVD SARD databases and built a dataset of over 100,000 files in C programming language with 123 types of vulnerabilities. The extensive experiments generate the best performance of over 93 accuracy in detecting security vulnerabilities.


Team Orienteering Coverage Planning with Uncertain Reward. Many municipalities and large organizations have fleets of vehicles that need to be coordinated for tasks such as garbage collection or infrastructure inspection. Motivated by this need, this paper focuses on the common subproblem in which a team of vehicles needs to plan coordinated routes to patrol an area over iterations while minimizing temporally and spatially dependent costs. In particular, at a specific location (e.g., a vertex on a graph), we assume the cost grows linearly in expectation with an unknown rate, and the cost is reset to zero whenever any vehicle visits the vertex (representing the robot servicing the vertex). We formulate this problem in graph terminology and call it Team Orienteering Coverage Planning with Uncertain Reward (TOCPUR). We propose to solve TOCPUR by simultaneously estimating the accumulated cost at every vertex on the graph and solving a novel variant of the Team Orienteering Problem (TOP) iteratively, which we call the Team Orienteering Coverage Problem (TOCP). We provide the first mixed integer programming formulation for the TOCP, as a significant adaptation of the original TOP. We introduce a new benchmark consisting of hundreds of randomly generated graphs for comparing different methods. We show the proposed solution outperforms both the exact TOP solution and a greedy algorithm. In addition, we provide a demo of our method on a team of three physical robots in a real world environment.


Proof of some congruence conjectures of Z. H. Sun involving Ap ' e ry like numbers. In this paper, we mainly prove the following conjecture of Z. H. Sun cite SH20 Let p 3 be a prime. Then sum k 0 p 1 binom 2k k frac 3k 1 ( 16) k f k equiv( 1) (p 1) 2 p p 3E p 3 pmod p 4 , where f n sum k 0 n binom n k 3 and E n stand for the n th Franel number and n th Euler number respectively.


Approximating the Derivative of Manifold valued Functions. We consider the approximation of manifold valued functions by embedding the manifold into a higher dimensional space, applying a vector valued approximation operator and projecting the resulting vector back to the manifold. It is well known that the approximation error for manifold valued functions is close to the approximation error for vector valued functions. This is not true anymore if we consider the derivatives of such functions. In our paper we give pre asymptotic error bounds for the approximation of the derivative of manifold valued function. In particular, we provide explicit constants that depend on the reach of the embedded manifold.


TriBERT Full body Human centric Audio visual Representation Learning for Visual Sound Separation. The recent success of transformer models in language, such as BERT, has motivated the use of such architectures for multi modal feature learning and tasks. However, most multi modal variants (e.g., ViLBERT) have limited themselves to visual linguistic data. Relatively few have explored its use in audio visual modalities, and none, to our knowledge, illustrate them in the context of granular audio visual detection or segmentation tasks such as sound source separation and localization. In this work, we introduce TriBERT a transformer based architecture, inspired by ViLBERT, which enables contextual feature learning across three modalities vision, pose, and audio, with the use of flexible co attention. The use of pose keypoints is inspired by recent works that illustrate that such representations can significantly boost performance in many audio visual scenarios where often one or more persons are responsible for the sound explicitly (e.g., talking) or implicitly (e.g., sound produced as a function of human manipulating an object). From a technical perspective, as part of the TriBERT architecture, we introduce a learned visual tokenization scheme based on spatial attention and leverage weak supervision to allow granular cross modal interactions for visual and pose modalities. Further, we supplement learning with sound source separation loss formulated across all three streams. We pre train our model on the large MUSIC21 dataset and demonstrate improved performance in audio visual sound source separation on that dataset as well as other datasets through fine tuning. In addition, we show that the learned TriBERT representations are generic and significantly improve performance on other audio visual tasks such as cross modal audio visual pose retrieval by as much as 66.7 in top 1 accuracy.


DeepCAT Deep Category Representation for Query Understanding in E commerce Search. Mapping a search query to a set of relevant categories in the product taxonomy is a significant challenge in e commerce search for two reasons 1) Training data exhibits severe class imbalance problem due to biased click behavior, and 2) queries with little customer feedback (e.g., tail queries) are not well represented in the training set, and cause difficulties for query understanding. To address these problems, we propose a deep learning model, DeepCAT, which learns joint word category representations to enhance the query understanding process. We believe learning category interactions helps to improve the performance of category mapping on minority classes, tail and torso queries. DeepCAT contains a novel word category representation model that trains the category representations based on word category co occurrences in the training set. The category representation is then leveraged to introduce a new loss function to estimate the category category co occurrences for refining joint word category embeddings. To demonstrate our model's effectiveness on minority categories and tail queries, we conduct two sets of experiments. The results show that DeepCAT reaches a 10 improvement on minority classes and a 7.1 improvement on tail queries over a state of the art label embedding model. Our findings suggest a promising direction for improving e commerce search by semantic modeling of taxonomy hierarchies.


Adaptive Explainable Continual Learning Framework for Regression Problems with Focus on Power Forecasts. Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn new tasks and overcome forgetting the knowledge obtained from the old tasks as the amount of data keeps increasing in applications. In this article, two continual learning scenarios will be proposed to describe the potential challenges in this context. Besides, based on our previous work regarding the CLeaR framework, which is short for continual learning for regression tasks, the work will be further developed to enable models to extend themselves and learn data successively. Research topics are related but not limited to developing continual deep learning algorithms, strategies for non stationarity detection in data streams, explainable and visualizable artificial intelligence, etc. Moreover, the framework and algorithm related hyperparameters should be dynamically updated in applications. Forecasting experiments will be conducted based on power generation and consumption data collected from real world applications. A series of comprehensive evaluation metrics and visualization tools can help analyze the experimental results. The proposed framework is expected to be generally applied to other constantly changing scenarios.


Tikhonov Regularized Iterative Methods for Nonlinear Problems. We consider the monotone inclusion problems in real Hilbert spaces. Proximal splitting algorithms are very popular technique to solve it and generally achieve weak convergence under mild assumptions. Researchers assume the strong conditions like strong convexity or strong monotonicity on the considered operators to prove strong convergence of the algorithms. Mann iteration method and normal S iteration method are popular methods to solve fixed point problems. We propose a new common fixed point algorithm based on normal S iteration method using Tikhonov regularization to find common fixed point of nonexpansive operators and prove strong convergence of the generated sequence to the set of common fixed points without assuming strong convexity and strong monotonicity. Based on proposed fixed point algorithm, we propose a forward backward type algorithm and a Douglas Rachford algorithm in connection with Tikhonov regularization to find the solution of monotone inclusion problems. Further, we consider the complexly structured monotone inclusion problems which are very popular these days. We also propose a strongly convergent forward backward type primal dual algorithm and a Douglas Rachford type primal dual algorithm to solve the monotone inclusion problems. Finally, we conduct a numerical experiment to solve image deblurring problems.


I Wish I Would Have Loved This One, But I Didn't A Multilingual Dataset for Counterfactual Detection in Product Reviews. Counterfactual statements describe events that did not or cannot take place. We consider the problem of counterfactual detection (CFD) in product reviews. For this purpose, we annotate a multilingual CFD dataset from Amazon product reviews covering counterfactual statements written in English, German, and Japanese languages. The dataset is unique as it contains counterfactuals in multiple languages, covers a new application area of e commerce reviews, and provides high quality professional annotations. We train CFD models using different text representation methods and classifiers. We find that these models are robust against the selectional biases introduced due to cue phrase based sentence selection. Moreover, our CFD dataset is compatible with prior datasets and can be merged to learn accurate CFD models. Applying machine translation on English counterfactual examples to create multilingual data performs poorly, demonstrating the language specificity of this problem, which has been ignored so far.


Science Factionalism How Group Identity Language Affects Public Engagement with Misinformation and Debunking Narratives on a Popular Q A Platform in China. Misinformation and intergroup bias are two pathologies challenging informed citizenship. This paper examines how identity language is used in misinformation and debunking messages about controversial science on Chinese digital public sphere, and their impact on how the public engage with science. We collected an eight year time series dataset of public discussion (N 6039) on one of the most controversial science issues in China (GMO) from a popular Q A platform, Zhihu. We found that both misinformation and debunking messages use a substantial amount of group identity languages when discussing the controversial science issue, which we define as science factionalism discussion about science is divided by factions that are formed upon science attitudes. We found that posts that use science factionalism receive more digital votes and comments, even among the science savvy community in China. Science factionalism also increases the use of negativity in public discourse. We discussed the implications of how science factionalism interacts with the digital attention economy to affect public engagement with science misinformation.


VLMo Unified Vision Language Pre Training with Mixture of Modality Experts. We present a unified Vision Language pretrained Model (VLMo) that jointly learns a dual encoder and a fusion encoder with a modular Transformer network. Specifically, we introduce Mixture of Modality Experts (MoME) Transformer, where each block contains a pool of modality specific experts and a shared self attention layer. Because of the modeling flexibility of MoME, pretrained VLMo can be fine tuned as a fusion encoder for vision language classification tasks, or used as a dual encoder for efficient image text retrieval. Moreover, we propose a stagewise pre training strategy, which effectively leverages large scale image only and text only data besides image text pairs. Experimental results show that VLMo achieves state of the art results on various vision language tasks, including VQA and NLVR2. The code and pretrained models are available at https aka.ms vlmo.


Amendable Generation for Dialogue State Tracking. In task oriented dialogue systems, recent dialogue state tracking methods tend to perform one pass generation of the dialogue state based on the previous dialogue state. The mistakes of these models made at the current turn are prone to be carried over to the next turn, causing error propagation. In this paper, we propose a novel Amendable Generation for Dialogue State Tracking (AG DST), which contains a two pass generation process (1) generating a primitive dialogue state based on the dialogue of the current turn and the previous dialogue state, and (2) amending the primitive dialogue state from the first pass. With the additional amending generation pass, our model is tasked to learn more robust dialogue state tracking by amending the errors that still exist in the primitive dialogue state, which plays the role of reviser in the double checking process and alleviates unnecessary error propagation. Experimental results show that AG DST significantly outperforms previous works in two active DST datasets (MultiWOZ 2.2 and WOZ 2.0), achieving new state of the art performances.


A Compositional Feature Embedding and Similarity Metric for Ultra Fine Grained Visual Categorization. Fine grained visual categorization (FGVC), which aims at classifying objects with small inter class variances, has been significantly advanced in recent years. However, ultra fine grained visual categorization (ultra FGVC), which targets at identifying subclasses with extremely similar patterns, has not received much attention. In ultra FGVC datasets, the samples per category are always scarce as the granularity moves down, which will lead to overfitting problems. Moreover, the difference among different categories is too subtle to distinguish even for professional experts. Motivated by these issues, this paper proposes a novel compositional feature embedding and similarity metric (CECS). Specifically, in the compositional feature embedding module, we randomly select patches in the original input image, and these patches are then replaced by patches from the images of different categories or masked out. Then the replaced and masked images are used to augment the original input images, which can provide more diverse samples and thus largely alleviate overfitting problem resulted from limited training samples. Besides, learning with diverse samples forces the model to learn not only the most discriminative features but also other informative features in remaining regions, enhancing the generalization and robustness of the model. In the compositional similarity metric module, a new similarity metric is developed to improve the classification performance by narrowing the intra category distance and enlarging the inter category distance. Experimental results on two ultra FGVC datasets and one FGVC dataset with recent benchmark methods consistently demonstrate that the proposed CECS method achieves the state of the art performance.


What is Event Knowledge Graph A Survey. Besides entity centric knowledge, usually organized as Knowledge Graph (KG), events are also an essential kind of knowledge in the world, which trigger the spring up of event centric knowledge representation form like Event KG (EKG). It plays an increasingly important role in many machine learning and artificial intelligence applications, such as intelligent search, question answering, recommendation, and text generation. This paper provides a comprehensive survey of EKG from history, ontology, instance, and application views. Specifically, to characterize EKG thoroughly, we focus on its history, definitions, schema induction, acquisition, related representative graphs systems, and applications. The development processes and trends are studied therein. We further summarize perspective directions to facilitate future research on EKG.


Holomorphic contact via Pascal map and operator theory. We give an intrinsic definition of point wise contact between holomorphic Hermitian vector bundles by introducing a canonical bundle map, called the Pascal map, on their jet bundles. Combined with a holomorphic gluing condition, point wise contact is further extended to contact along an analytic hyper surface and we characterize it by the curvatures and their covariant derivatives on the vector bundles. The Pascal map has a realization in operator theory where our study applies to unitary equivalence of shift operators on function spaces.


Response Time Analysis and Optimization for Probabilistic Conditional Parallel DAG Tasks. Real time systems increasingly use multicore processors in order to satisfy thermal, power, and computational requirements. To exploit the architectural parallelism offered by the multicore processors, parallel task models, scheduling algorithms and response time analyses with respect to real time constraints have to be provided. In this paper, we propose a reservation based scheduling algorithm for sporadic constrained deadline parallel conditional DAG tasks with probabilistic execution behaviour for applications that can tolerate bounded number of deadline misses and bounded tardiness. We devise design rules and analyses to guarantee bounded tardiness for a specified bounded probability for k consecutive deadline misses without enforcing late jobs to be immediately aborted.


Predictive Wireless Based Status Update for Communication Agnostic Sampling. In a wireless network that conveys status updates from sources (i.e., sensors) to destinations, one of the key issues studied by existing literature is how to design an optimal source sampling strategy on account of the communication constraints which are often modeled as queues. In this paper, an alternative perspective is presented a novel status aware communication scheme, namely emph parallel communications , is proposed which allows sensors to be communication agnostic. Specifically, the proposed scheme can determine, based on an online prediction functionality, whether a status packet is worth transmitting considering both the network condition and status prediction, such that sensors can generate status packets without communication constraints. We evaluate the proposed scheme on a Software Defined Radio (SDR) test platform, which is integrated with a collaborative autonomous driving simulator, i.e., Simulation of Urban Mobility (SUMO), to produce realistic vehicle control models and road conditions. The results show that with online status predictions, the channel occupancy is significantly reduced, while guaranteeing low status recovery error. Then the framework is applied to two scenarios a multi density platooning scenario, and a flight formation control scenario. Simulation results show that the scheme achieves better performance on the network level, in terms of keeping the minimum safe distance in both vehicle platooning and flight control.


Dissipative and conservative local discontinuous Galerkin methods for the Fornberg Whitham type equations. In this paper, we construct high order energy dissipative and conservative local discontinuous Galerkin methods for the Fornberg Whitham type equations. We give the proofs for the dissipation and conservation for related conservative quantities. The corresponding error estimates are proved for the proposed schemes. The capability of our schemes for different types of solutions is shown via several numerical experiments. The dissipative schemes have good behavior for shock solutions, while for a long time approximation, the conservative schemes can reduce the shape error and the decay of amplitude significantly


Objective Robustness in Deep Reinforcement Learning. We study objective robustness failures, a type of out of distribution robustness failure in reinforcement learning (RL). Objective robustness failures occur when an RL agent retains its capabilities out of distribution yet pursues the wrong objective. This kind of failure presents different risks than the robustness problems usually considered in the literature, since it involves agents that leverage their capabilities to pursue the wrong objective rather than simply failing to do anything useful. We provide the first explicit empirical demonstrations of objective robustness failures and present a partial characterization of its causes.


Semisimplicity, Glivenko theorems, and the excluded middle. We formulate a general, signature independent form of the law of the excluded middle and prove that a logic is semisimple if and only if it enjoys this law, provided that it satisfies a weak form of the so called inconsistency lemma of Raftery. We then show that this equivalence can be used to provide simple syntactic proofs of the theorems of Kowalski and Kracht characterizing the semisimple varieties of FLew algebras and Boolean algebras with operators, and to extend them to FLe algebras and Heyting algebras with operators. Moreover, under stronger assumptions this correspondence works at the level of individual models the semisimple models of such a logic are precisely those which satisfy an axiomatic form of the law of the excluded middle, and a Glivenko like connection obtains between the logic and its extension by the axiom of the excluded middle. This in particular subsumes the well known Glivenko theorems relating intuitionistic and classical logic and the modal logics S4 and S5. As a consequence, we also obtain a description of the subclassical substructural logics which are Glivenko related to classical logic.


Efficient energy preserving exponential integrators for multi components Hamiltonian systems. In this paper, we develop a framework to construct energy preserving methods for multi components Hamiltonian systems, combining the exponential integrator and the partitioned averaged vector field method. This leads to numerical schemes with both advantages of long time stability and excellent behavior for highly oscillatory or stiff problems. Compared to the existing energy preserving exponential integrators (EP EI) in practical implementation, our proposed methods are much efficient which can at least be computed by subsystem instead of handling a nonlinear coupling system at a time. Moreover, for most cases, such as the Klein Gordon Schr " o dinger equations and the Klein Gordon Zakharov equations considered in this paper, the computational cost can be further reduced. Specifically, one part of the derived schemes is totally explicit, and the other is linearly implicit. In addition, we present rigorous proof of conserving the original energy of Hamiltonian systems, in which an alternative technique is utilized so that no additional assumptions are required, in contrast to the proof strategies used for the existing EP EI. Numerical experiments are provided to demonstrate the significant advantages in accuracy, computational efficiency, and the ability to capture highly oscillatory solutions.


Liouville results for fully nonlinear equations modeled on H "ormander vector fields II. Carnot groups and Grushin geometries. The paper treats second order fully nonlinear degenerate elliptic equations having a family of subunit vector fields satisfying a full rank bracket condition. It studies Liouville properties for viscosity sub and supersolutions in the whole space, namely, that under a suitable bound at infinity from above and, respectively, from below, they must be constant. In a previous paper we proved an abstract result and discussed operators on the Heisenberg group. Here we consider various families of vector fields the generators of a Carnot group, with more precise results for those of step 2, in particular H type groups and free Carnot groups, the Grushin and the Heisenberg Greiner vector fields. All these cases are relevant in sub Riemannian geometry and have in common the existence of a homogeneous norm that we use for building Lyapunov like functions for each operator. We give explicit sufficient conditions on the size and sign of the first and zero th order terms in the equations and discuss their optimality.


Homogeneous multigrid for embedded discontinuous Galerkin methods. We introduce a homogeneous multigrid method in the sense that it uses the same embedded discontinuous Galerkin (EDG) discretization scheme for Poisson's equation on all levels. In particular, we use the injection operator developed in LuRK2020 for HDG and prove optimal convergence of the method under the assumption of elliptic regularity. Numerical experiments underline our analytical findings.


Online Binary Models are Promising for Distinguishing Temporally Consistent Computer Usage Profiles. This paper investigates whether computer usage profiles comprised of process , network , mouse , and keystroke related events are unique and consistent over time in a naturalistic setting, discussing challenges and opportunities of using such profiles in applications of continuous authentication. We collected ecologically valid computer usage profiles from 31 MS Windows 10 computer users over 8 weeks and submitted this data to comprehensive machine learning analysis involving a diverse set of online and offline classifiers. We found that (i) profiles were mostly consistent over the 8 week data collection period, with most (83.9 ) repeating computer usage habits on a daily basis (ii) computer usage profiling has the potential to uniquely characterize computer users (with a maximum F score of 99.90 ) (iii) network related events were the most relevant features to accurately recognize profiles (95.69 of the top features distinguishing users were network related) and (iv) binary models were the most well suited for profile recognition, with better results achieved in the online setting compared to the offline setting (maximum F score of 99.90 vs. 95.50 ).


Multi center decomposition of molecular densities a mathematical perspective. The aim of this paper is to analyze from a mathematical perspective some existing schemes to partition a molecular density into several atomic contributions, with a specific focus on Iterative Stockholder Atom (ISA) methods. We provide a unified mathematical framework to describe the latter family of methods and propose a new scheme, named L ISA (for linear approximation of ISA). We prove several important mathematical properties of the ISA and L ISA minimization problems and show that the so called ISA algorithms can be viewed as alternating minimization schemes, which in turn enables us to obtain new convergence results for these numerical methods. Specific mathematical properties of the ISA decomposition for diatomic systems are also presented. We also review the basis space oriented Distributed Multipole Analysis method, the mathematical formulation of which is also clarified. Different schemes are numerically compared on different molecules and we discuss the advantages and drawbacks of each approach.


Revisiting Dockerfiles in Open Source Software Over Time. Docker is becoming ubiquitous with containerization for developing and deploying applications. Previous studies have analyzed Dockerfiles that are used to create container images in order to better understand how to improve Docker tooling. These studies obtain Dockerfiles using either Docker Hub or Github. In this paper, we revisit the findings of previous studies using the largest set of Dockerfiles known to date with over 9.4 million unique Dockerfiles found in the World of Code infrastructure spanning from 2013 2020. We contribute a historical view of the Dockerfile format by analyzing the Docker engine changelogs and use the history to enhance our analysis of Dockerfiles. We also reconfirm previous findings of a downward trend in using OS images and an upward trend of using language images. As well, we reconfirm that Dockerfile smell counts are slightly decreasing meaning that Dockerfile authors are likely getting better at following best practices. Based on these findings, it indicates that previous analyses from prior works have been correct in many of their findings and their suggestions to build better tools for Docker image creation are further substantiated.


Human Pose Regression with Residual Log likelihood Estimation. Heatmap based methods dominate in the field of human pose estimation by modelling the output distribution through likelihood heatmaps. In contrast, regression based methods are more efficient but suffer from inferior performance. In this work, we explore maximum likelihood estimation (MLE) to develop an efficient and effective regression based methods. From the perspective of MLE, adopting different regression losses is making different assumptions about the output density function. A density function closer to the true distribution leads to a better regression performance. In light of this, we propose a novel regression paradigm with Residual Log likelihood Estimation (RLE) to capture the underlying output distribution. Concretely, RLE learns the change of the distribution instead of the unreferenced underlying distribution to facilitate the training process. With the proposed reparameterization design, our method is compatible with off the shelf flow models. The proposed method is effective, efficient and flexible. We show its potential in various human pose estimation tasks with comprehensive experiments. Compared to the conventional regression paradigm, regression with RLE bring 12.4 mAP improvement on MSCOCO without any test time overhead. Moreover, for the first time, especially on multi person pose estimation, our regression method is superior to the heatmap based methods. Our code is available at https github.com Jeff sjtu res loglikelihood regression


Targeting Makes Sample Efficiency in Auction Design. This paper introduces the targeted sampling model in optimal auction design. In this model, the seller may specify a quantile interval and sample from a buyer's prior restricted to the interval. This can be interpreted as allowing the seller to, for example, examine the top 40 percents bids from previous buyers with the same characteristics. The targeting power is quantified with a parameter Delta in 0, 1 which lower bounds how small the quantile intervals could be. When Delta 1 , it degenerates to Cole and Roughgarden's model of i.i.d. samples when it is the idealized case of Delta 0 , it degenerates to the model studied by Chen et al. (2018). For instance, for n buyers with bounded values in 0, 1 , tilde O ( epsilon 1 ) targeted samples suffice while it is known that at least tilde Omega (n epsilon 2 ) i.i.d. samples are needed. In other words, targeted sampling with sufficient targeting power allows us to remove the linear dependence in n , and to improve the quadratic dependence in epsilon 1 to linear. In this work, we introduce new technical ingredients and show that the number of targeted samples sufficient for learning an epsilon optimal auction is substantially smaller than the sample complexity of i.i.d. samples for the full spectrum of Delta in 0, 1) . Even with only mild targeting power, i.e., whenever Delta o(1) , our targeted sample complexity upper bounds are strictly smaller than the optimal sample complexity of i.i.d. samples.


Adjusting the Ground Truth Annotations for Connectivity Based Learning to Delineate. Deep learning based approaches to delineating 3D structure depend on accurate annotations to train the networks. Yet, in practice, people, no matter how conscientious, have trouble precisely delineating in 3D and on a large scale, in part because the data is often hard to interpret visually and in part because the 3D interfaces are awkward to use. In this paper, we introduce a method that explicitly accounts for annotation inaccuracies. To this end, we treat the annotations as active contour models that can deform themselves while preserving their topology. This enables us to jointly train the network and correct potential errors in the original annotations. The result is an approach that boosts performance of deep networks trained with potentially inaccurate annotations.


High order cut discontinuous Galerkin methods for hyperbolic conservation laws in one space dimension. In this paper, we develop a family of high order cut discontinuous Galerkin (DG) methods for hyperbolic conservation laws in one space dimension. The ghost penalty stabilization is used to stabilize the scheme for small cut elements. The analysis shows that our proposed methods have similar stability and accuracy properties as the standard DG methods on a regular mesh. We also prove that the cut DG method with piecewise constants in space is total variation diminishing (TVD). We use the strong stability preserving Runge Kutta method for time discretization and the time step is independent of the size of cut element. Numerical examples demonstrate that the cut DG methods are high order accurate for smooth problems and perform well for discontinuous problems.


Miti DETR Object Detection based on Transformers with Mitigatory Self Attention Convergence. Object Detection with Transformers (DETR) and related works reach or even surpass the highly optimized Faster RCNN baseline with self attention network architectures. Inspired by the evidence that pure self attention possesses a strong inductive bias that leads to the transformer losing the expressive power with respect to network depth, we propose a transformer architecture with a mitigatory self attention mechanism by applying possible direct mapping connections in the transformer architecture to mitigate the rank collapse so as to counteract feature expression loss and enhance the model performance. We apply this proposal in object detection tasks and develop a model named Miti DETR. Miti DETR reserves the inputs of each single attention layer to the outputs of that layer so that the "non attention" information has participated in any attention propagation. The formed residual self attention network addresses two critical issues (1) stop the self attention networks from degenerating to rank 1 to the maximized degree and (2) further diversify the path distribution of parameter update so that easier attention learning is expected. Miti DETR significantly enhances the average detection precision and convergence speed towards existing DETR based models on the challenging COCO object detection dataset. Moreover, the proposed transformer with the residual self attention network can be easily generalized or plugged in other related task models without specific customization.


Effects of Composition on Mechanical and Antibacterial Properties of Hydroxyapatite Gray Titania Coating Fabricated by Suspension Plasma Spraying. This study aims at revealing the effect of composition on mechanical and antibacterial properties of hydroxyapatite gray Titania coating for biomedical applications. HAp is a bioceramic material used as a plasma sprayed coating to promote osseointegra tion of femoral stems. Biomaterial coatings are fabricated mostly using atmospheric plasma spray (APS). However, the conventional plasma spray process requires hydrox yapatite powder with good flow, and to prepare such free flowing powder, agglomer ation, such as spray drying, fusing, and crushing is used. Therefore, it is impossible to spray nano powder using conventional methods. Here, we designed a suspension feeding system to feed nanoparticles using a liquid carrier. Suspension plasma spray (SPS) successfully deposited homogeneous HAp Gray Titania coating with less poros ity on the surface of titanium substrates. The microstructure of coatings with differ ent compositions was then characterized using scanning electron microscopy, X ray diffraction, and Raman spectroscopy to identify the crystal structure. All results con sistently demonstrated that SPS could transform Ti2 O3 into TiO2 with mixed Magneli phases, such as Ti4 O7 and Ti3 O5, which usually show photocatalytic activity. Interfacial strength, hardness, young modulus, and fracture toughness were also improved with a high concentration of TiO2. Antibacterial test for E.Coli under LED light re vealed that SPSed HAp Gray Titania coating could significantly enhance antibacterial properties. The possible underlying mechanism of enhanced antibacterial properties can be attributed to increased Magneli phases and better bacterial adhesion caused by hydrophilic properties due to submicron size particles. SPS can fabricate visible light responsive antibacterial coating, which can be used for medical devices.


Euclidean numbers and numerosities. Several different versions of the theory of numerosities have been introduced in the literature. Here, we unify these approaches in a consistent frame through the notion of set of labels, relating numerosities with the Kiesler field of Euclidean numbers. This approach allows to easily introduce, by means of numerosities, ordinals and their natural operations, as well as the Lebesgue measure as a counting measure on the reals.


Big quantum cohomology of even dimensional intersections of two quadrics. For even dimensional smooth complete intersections, of dimension at least 4, of two quadric hypersurfaces in a projective space, we study the genus zero Gromov Witten invariants by the monodromy group of its whole family. We compute the invariants of length 4 and show that, besides a special invariant, all genus zero Gromov Witten invariants can be reconstructed from the invariants of length 4. In dimension 4, we compute the special invariant by solving a curve counting problem. We show that the generating function of genus zero Gromov Witten invariants has a positive radius of convergence. We show that, although the small quantum cohomology is not semisimple, the associated Frobenius manifold is generically tame semisimple.


t Entropy A New Measure of Uncertainty with Some Applications. The concept of Entropy plays a key role in Information Theory, Statistics, and Machine Learning.This paper introduces a new entropy measure, called the t entropy, which exploits the concavity of the inverse tan function. We analytically show that the proposed t entropy satisfies the prominent axiomatic properties of an entropy measure. We demonstrate an application of the proposed entropy measure for multi level thresholding of images. We also propose the entropic loss as a measure of the divergence between two probability distributions, which leads to robust estimators in the context of parametric statistical inference. The consistency and asymptotic breakdown point of the proposed estimator are mathematically analyzed. Finally, we show an application of the t entropy to feature weighted data clustering.


GLocalX From Local to Global Explanations of Black Box AI Models. Artificial Intelligence (AI) has come to prominence as one of the major components of our society, with applications in most aspects of our lives. In this field, complex and highly nonlinear machine learning models such as ensemble models, deep neural networks, and Support Vector Machines have consistently shown remarkable accuracy in solving complex tasks. Although accurate, AI models often are "black boxes" which we are not able to understand. Relying on these models has a multifaceted impact and raises significant concerns about their transparency. Applications in sensitive and critical domains are a strong motivational factor in trying to understand the behavior of black boxes. We propose to address this issue by providing an interpretable layer on top of black box models by aggregating "local" explanations. We present GLocalX, a "local first" model agnostic explanation method. Starting from local explanations expressed in form of local decision rules, GLocalX iteratively generalizes them into global explanations by hierarchically aggregating them. Our goal is to learn accurate yet simple interpretable models to emulate the given black box, and, if possible, replace it entirely. We validate GLocalX in a set of experiments in standard and constrained settings with limited or no access to either data or local explanations. Experiments show that GLocalX is able to accurately emulate several models with simple and small models, reaching state of the art performance against natively global solutions. Our findings show how it is often possible to achieve a high level of both accuracy and comprehensibility of classification models, even in complex domains with high dimensional data, without necessarily trading one property for the other. This is a key requirement for a trustworthy AI, necessary for adoption in high stakes decision making applications.


Multiplicities of Jumping Numbers. We study multiplicities of jumping numbers of multiplier ideals in a smooth variety of arbitrary dimension. We prove that the multiplicity function is a quasi polynomial, hence proving that the Poincar 'e series is a rational function. We further study when the various components of the quasi polynomial have the highest possible degree and relate it to jumping numbers contributed by Rees valuations. Finally, we study the special case of monomial ideals.


Disentangling the Roles of Curation, Data Augmentation and the Prior in the Cold Posterior Effect. The "cold posterior effect" (CPE) in Bayesian deep learning describes the uncomforting observation that the predictive performance of Bayesian neural networks can be significantly improved if the Bayes posterior is artificially sharpened using a temperature parameter T 1. The CPE is problematic in theory and practice and since the effect was identified many researchers have proposed hypotheses to explain the phenomenon. However, despite this intensive research effort the effect remains poorly understood. In this work we provide novel and nuanced evidence relevant to existing explanations for the cold posterior effect, disentangling three hypotheses 1. The dataset curation hypothesis of Aitchison (2020) we show empirically that the CPE does not arise in a real curated data set but can be produced in a controlled experiment with varying curation strength. 2. The data augmentation hypothesis of Izmailov et al. (2021) and Fortuin et al. (2021) we show empirically that data augmentation is sufficient but not necessary for the CPE to be present. 3. The bad prior hypothesis of Wenzel et al. (2020) we use a simple experiment evaluating the relative importance of the prior and the likelihood, strongly linking the CPE to the prior. Our results demonstrate how the CPE can arise in isolation from synthetic curation, data augmentation, and bad priors. Cold posteriors observed "in the wild" are therefore unlikely to arise from a single simple cause as a result, we do not expect a simple "fix" for cold posteriors.


Artificial Intelligence Narratives An Objective Perspective on Current Developments. This work provides a starting point for researchers interested in gaining a deeper understanding of the big picture of artificial intelligence (AI). To this end, a narrative is conveyed that allows the reader to develop an objective view on current developments that is free from false promises that dominate public communication. An essential takeaway for the reader is that AI must be understood as an umbrella term encompassing a plethora of different methods, schools of thought, and their respective historical movements. Consequently, a bottom up strategy is pursued in which the field of AI is introduced by presenting various aspects that are characteristic of the subject. This paper is structured in three parts (i) Discussion of current trends revealing false public narratives, (ii) an introduction to the history of AI focusing on recurring patterns and main characteristics, and (iii) a critical discussion on the limitations of current methods in the context of the potential emergence of a strong(er) AI. It should be noted that this work does not cover any of these aspects holistically rather, the content addressed is a selection made by the author and subject to a didactic strategy.


Discontinuous Galerkin and C 0 IP finite element approximation of periodic Hamilton Jacobi Bellman Isaacs problems with application to numerical homogenization. In the first part of the paper, we study the discontinuous Galerkin (DG) and C 0 interior penalty ( C 0 IP) finite element approximation of the periodic strong solution to the fully nonlinear second order Hamilton Jacobi Bellman Isaacs (HJBI) equation with coefficients satisfying the Cordes condition. We prove well posedness and perform abstract a posteriori and a priori analyses which apply to a wide family of numerical schemes. These periodic problems arise as the corrector problems in the homogenization of HJBI equations. The second part of the paper focuses on the numerical approximation to the effective Hamiltonian of ergodic HJBI operators via DG C 0 IP finite element approximations to approximate corrector problems. Finally, we provide numerical experiments demonstrating the performance of the numerical schemes.


Bayesian U Net for Segmenting Glaciers in SAR Imagery. Fluctuations of the glacier calving front have an important influence over the ice flow of whole glacier systems. It is therefore important to precisely monitor the position of the calving front. However, the manual delineation of SAR images is a difficult, laborious and subjective task. Convolutional neural networks have previously shown promising results in automating the glacier segmentation in SAR images, making them desirable for further exploration of their possibilities. In this work, we propose to compute uncertainty and use it in an Uncertainty Optimization regime as a novel two stage process. By using dropout as a random sampling layer in a U Net architecture, we create a probabilistic Bayesian Neural Network. With several forward passes, we create a sampling distribution, which can estimate the model uncertainty for each pixel in the segmentation mask. The additional uncertainty map information can serve as a guideline for the experts in the manual annotation of the data. Furthermore, feeding the uncertainty map to the network leads to 95.24 Dice similarity, which is an overall improvement in the segmentation performance compared to the state of the art deterministic U Net based glacier segmentation pipelines.


CleanAirNowKC Building Community Power by Improving Data Accessibility. As cities continue to grow globally, air pollution is increasing at an alarming rate, causing a significant negative impact on public health. One way to affect the negative impact is to regulate the producers of such pollution through policy implementation and enforcement. CleanAirNowKC (CAN KC) is an environmental justice organization based in Kansas City (KC), Kansas. As part of their organizational objectives, they have to date deployed nine PurpleAir air quality sensors in different locations about which the community has expressed concern. In this paper, we have implemented an interactive map that can help the community members to monitor air quality efficiently. The system also allows for reporting and tracking industrial emissions or toxic releases, which will further help identify major contributors to pollution. These resources can serve an important role as evidence that will assist in advocating for community driven just policies to improve the air quality regulation in Kansas City.


The inductive McKay Navarro conditions for the prime 2 and some groups of Lie type. For a prime ell , the McKay conjecture suggests a bijection between the set of irreducible characters of a finite group with ell' degree and the corresponding set for the normalizer of a Sylow ell subgroup. Navarro's refinement suggests that the values of the characters on either side of this bijection should also be related, proposing that the bijection commutes with certain Galois automorphisms. Recently, Navarro Sp aeth Vallejo have reduced the McKay Navarro conjecture to certain "inductive" conditions on finite simple groups. We prove that these inductive McKay Navarro (also called the inductive Galois McKay) conditions hold for the prime ell 2 for several groups of Lie type, including the untwisted groups without nontrivial graph automorphisms.


Formalising the Foundations of Discrete Reinforcement Learning in Isabelle HOL. We present a formalisation of finite Markov decision processes with rewards in the Isabelle theorem prover. We focus on the foundations required for dynamic programming and the use of reinforcement learning agents over such processes. In particular, we derive the Bellman equation from first principles (in both scalar and vector form), derive a vector calculation that produces the expected value of any policy p, and go on to prove the existence of a universally optimal policy where there is a discounting factor less than one. Lastly, we prove that the value iteration and the policy iteration algorithms work in finite time, producing an epsilon optimal and a fully optimal policy respectively.


Stable diffeomorphism classification of some unorientable 4 manifolds. Kreck's modified surgery theory reduces the classification of closed, connected 4 manifolds, up to connect sum with some number of copies of S 2 times S 2 , to a series of bordism questions. We implement this in the case of unorientable 4 manifolds M and show that for some choices of fundamental groups, the computations simplify considerably. We use this to solve some cases in which pi 1(M) is finite of order 2 mod 4 under an assumption on cohomology, there are nine stable diffeomorphism classes for which M is pin , one stable diffeomorphism class for which M is pin , and four stable diffeomorphism classes for which M is neither. We also determine the corresponding stable homeomorphism classes.


Lookup subnet based Spatial Graph Convolutional neural Network. Convolutional Neural Networks(CNNs) has achieved remarkable performance breakthrough in Euclidean structure data. Recently, aggregation transformation based Graph Neural networks(GNNs) gradually produce a powerful performance on non Euclidean data. In this paper, we propose a cross correlation based graph convolution method allowing to naturally generalize CNNs to non Euclidean domains and inherit the excellent natures of CNNs, such as local filters, parameter sharing, flexible receptive field, etc. Meanwhile, it leverages dynamically generated convolution kernel and cross correlation operators to address the shortcomings of prior methods based on aggregation transformation or their approximations. Our method has achieved or matched popular state of the art results across three established graph benchmarks the Cora, Citeseer, and Pubmed citation network datasets.


Raising Secure Coding Awareness for Software Developers in the Industry. Many industrial IT security standards and policies mandate the usage of a secure coding methodology in the software development process. This implies two different aspects first, secure coding must be based on a set of secure coding guidelines, and second software developers must be aware of these secure coding practices. On the one side, secure coding guidelines seems a bit like a black art while there exist abstract guidelines that are widely accepted, low level secure coding guidelines for different programming languages are scarce. On the other side, once a set of secure coding guidelines is chosen, a good methodology is needed to make them known by the people which should be using them, i.e. software developers. Motivated both by the secure coding requirements from industry standards and also by the mandate to train staff on IT security by the global industry initiative "Charter of Trust", this paper presents an overview of important research questions on how to choose secure coding guidelines and on how to raise software developer awareness for secure coding using serious games.


Weighted Conditional EL bot Knowledge Bases with Integer Weights an ASP Approach. Weighted knowledge bases for description logics with typicality have been recently considered under a "concept wise" multipreference semantics (in both the two valued and fuzzy case), as the basis of a logical semantics of Multilayer Perceptrons. In this paper we consider weighted conditional EL bot knowledge bases in the two valued case, and exploit ASP and asprin for encoding concept wise multipreference entailment for weighted KBs with integer weights.


Companion paper for Well posedness of general cross diffusion systems. The paper entitled "Well posedness of general cross diffusion systems", by C. Choquet, C. Rosier, L. Rosier, J. Diff. Eq. 2021, is devoted to the mathematical analysis of the Cauchy problem for general cross diffusion systems without any assumption about its entropic structure. The absence of this type of hypothesis is strongly felt for two questions the uniqueness of the solution, despite the nonlinear coupling of the highest derivatives terms, and the maximum principle. The article is therefore largely devoted to these two points. The answers are provided at the cost of certain assumptions or technicalities, mainly (i) the ratios between the diffusion and cross diffusion coefficients has to be drastically controlled for sufficiently enhancing the regularity of the solution, namely its gradient belongs to the space L 4 ((0,T) times Omega ) the regularity is obtained by adapting the classical Meyer's to the nonlinear parabolic setting under consideration (ii) the source terms have to ensure the confinement of the solution. The present "companion" paper aims at showing where more classical analysis tools fail to solve these questions and gives some additional clarifications.


On Encoding LF in a Predicate Logic over Simply Typed Lambda Terms. Felty and Miller have described what they claim to be a faithful encoding of the dependently typed lambda calculus LF in the logic of hereditary Harrop formulas, a sublogic of an intuitionistic variant of Church's Simple Theory of Types. Their encoding is based roughly on translating object expressions in LF into terms in a simply typed lambda calculus by erasing dependencies in typing and then recapturing the erased dependencies through the use of predicates. Unfortunately, this idea does not quite work. In particular, we provide a counterexample to the claim that the described encoding is faithful. The underlying reason for the falsity of the claim is that the mapping from dependently typed lambda terms to simply typed ones is not one to one and hence the inverse transformation is ambiguous. This observation has a broad implication for other related encodings.


3D SiamRPN An End to End Learning Method for Real Time 3D Single Object Tracking Using Raw Point Cloud. 3D single object tracking is a key issue for autonomous following robot, where the robot should robustly track and accurately localize the target for efficient following. In this paper, we propose a 3D tracking method called 3D SiamRPN Network to track a single target object by using raw 3D point cloud data. The proposed network consists of two subnetworks. The first subnetwork is feature embedding subnetwork which is used for point cloud feature extraction and fusion. In this subnetwork, we first use PointNet to extract features of point cloud from template and search branches. Then, to fuse the information of features in the two branches and obtain their similarity, we propose two cross correlation modules, named Pointcloud wise and Point wise respectively. The second subnetwork is region proposal network(RPN), which is used to get the final 3D bounding box of the target object based on the fusion feature from cross correlation modules. In this subnetwork, we utilize the regression and classification branches of a region proposal subnetwork to obtain proposals and scores, thus get the final 3D bounding box of the target object. Experimental results on KITTI dataset show that our method has a competitive performance in both Success and Precision compared to the state of the art methods, and could run in real time at 20.8 FPS. Additionally, experimental results on H3D dataset demonstrate that our method also has good generalization ability and could achieve good tracking performance in a new scene without re training.


LiftPool Bidirectional ConvNet Pooling. Pooling is a critical operation in convolutional neural networks for increasing receptive fields and improving robustness to input variations. Most existing pooling operations downsample the feature maps, which is a lossy process. Moreover, they are not invertible upsampling a downscaled feature map can not recover the lost information in the downsampling. By adopting the philosophy of the classical Lifting Scheme from signal processing, we propose LiftPool for bidirectional pooling layers, including LiftDownPool and LiftUpPool. LiftDownPool decomposes a feature map into various downsized sub bands, each of which contains information with different frequencies. As the pooling function in LiftDownPool is perfectly invertible, by performing LiftDownPool backward, a corresponding up pooling layer LiftUpPool is able to generate a refined upsampled feature map using the detail sub bands, which is useful for image to image translation challenges. Experiments show the proposed methods achieve better results on image classification and semantic segmentation, using various backbones. Moreover, LiftDownPool offers better robustness to input corruptions and perturbations.


Riesz transform associated with the fractional Fourier transform and applications. Since Zayed cite Zayed, 1998 z2 introduced the fractional Hilbert transform related to the fractional Fourier transform, this transform has been widely concerned and applied in the field of signal processing. Recently, Chen, the first, second and fourth authors cite Chen et al, 2021 cfgw attribute it to the operator corresponding to fractional multiplier, but it is only limited to 1 dimensional case. This paper naturally considers the high dimensional situation. We introduce the fractional Riesz transform associated with fractional Fourier transform, in which the chirp function is the key factor and the technical barriers to be overcome. Furthermore, after equipping with chirp functions, we introduce and investigate the boundedness of singular integral operators, the dual properties of Hardy spaces and BMO spaces as well as the applications of theory of fractional multiplier in partial differential equation, which completely matched some classical results. Through numerical simulation, we give the physical and geometric interpretation of the high dimensional fractional multiplier theorem. Finally, we present the application of the fractional Riesz transform in edge detection, which verifies the prediction proposed in cite Xu et al, 2016 xxwqwy . Moreover, the application presented in this paper can also be considered as the high dimensional case of the application of the continuous fractional Hilbert transform in edge detection in cite Pei and Yeh, 2000 py .


Enhancing the Usability of Self service Kiosks for Older Adults Effects of Using Privacy Partitions and Chairs. This study aimed to evaluate the effects of possible physical design features of self service kiosks (SSK), side and back partitions and chairs, on workload and task performance of older users during a typical SSK task. The study comparatively evaluated eight physical SSK design alternatives, and younger and older participants performed a menu ordering task using each physical design alternative. Older participants showed a large variation in task performance across the design alternatives indicating stronger impacts of the physical design features. In particular, sitting significantly reduced task completion time and workload in multiple dimensions, including time pressure and frustration. In addition, the use of either side or back partitions reduced mean ratings of mental demand and effort. The study suggests placing chairs and either side or back partitions to enhance older adults' user experience. The use of the proposed physical design recommendations would greatly help them use SSK more effectively.


Inverse Designed Photonic Crystal Circuits for Optical Beam Steering. The ability of photonic crystal waveguides (PCWs) to confine and slow down light makes them an ideal component to enhance the performance of various photonic devices, such as optical modulators or sensors. However, the integration of PCWs in photonic applications poses design challenges, most notably, engineering the PCW mode dispersion and creating efficient coupling devices. Here, we solve these challenges with photonic inverse design, and experimentally demonstrate a slow light PCW optical phased array (OPA) with a wide steering range. Even and odd mode PCWs are engineered for a group index of 25, over a bandwidth of 20nm and 12nm, respectively. Additionally, for both PCW designs, we create strip waveguide couplers and free space vertical couplers. Finally, also relying on inverse design, the radiative losses of the PCW are engineered, allowing us to construct OPAs with a 20 deg steering range in a 20nm bandwidth.


Merly.jl Web Framework in Julia. Merly.jl is a package for creating web applications in Julia. It presents features such as the creation of endpoints with function notation and with macro notation, handling of static files, use of path parameters, processing of data sent by a web client in the body in a personalized way, handling of CORS and compatibility with the use of middleware. It presents a familiar syntax with the rest of the most popular web frameworks without neglecting the execution performance. This manuscript mentions the operation and main features of Merly.jl


Real time Streaming Perception System for Autonomous Driving. Nowadays, plenty of deep learning technologies are being applied to all aspects of autonomous driving with promising results. Among them, object detection is the key to improve the ability of an autonomous agent to perceive its environment so that it can (re)act. However, previous vision based object detectors cannot achieve satisfactory performance under real time driving scenarios. To remedy this, we present the real time steaming perception system in this paper, which is also the 2nd Place solution of Streaming Perception Challenge (Workshop on Autonomous Driving at CVPR 2021) for the detection only track. Unlike traditional object detection challenges, which focus mainly on the absolute performance, streaming perception task requires achieving a balance of accuracy and latency, which is crucial for real time autonomous driving. We adopt YOLOv5 as our basic framework, data augmentation, Bag of Freebies, and Transformer are adopted to improve streaming object detection performance with negligible extra inference cost. On the Argoverse HD test set, our method achieves 33.2 streaming AP (34.6 streaming AP verified by the organizer) under the required hardware. Its performance significantly surpasses the fixed baseline of 13.6 (host team), demonstrating the potentiality of application.


Player Tracking and Identification in Ice Hockey. Tracking and identifying players is a fundamental step in computer vision based ice hockey analytics. The data generated by tracking is used in many other downstream tasks, such as game event detection and game strategy analysis. Player tracking and identification is a challenging problem since the motion of players in hockey is fast paced and non linear when compared to pedestrians. There is also significant camera panning and zooming in hockey broadcast video. Identifying players in ice hockey is challenging since the players of the same team look almost identical, with the jersey number the only discriminating factor between players. In this paper, an automated system to track and identify players in broadcast NHL hockey videos is introduced. The system is composed of three components (1) Player tracking, (2) Team identification and (3) Player identification. Due to the absence of publicly available datasets, the datasets used to train the three components are annotated manually. Player tracking is performed with the help of a state of the art tracking algorithm obtaining a Multi Object Tracking Accuracy (MOTA) score of 94.5 . For team identification, the away team jerseys are grouped into a single class and home team jerseys are grouped in classes according to their jersey color. A convolutional neural network is then trained on the team identification dataset. The team identification network gets an accuracy of 97 on the test set. A novel player identification model is introduced that utilizes a temporal one dimensional convolutional network to identify players from player bounding box sequences. The player identification model further takes advantage of the available NHL game roster data to obtain a player identification accuracy of 83 .


Launchers and Targets in Social Networks. Influence propagation in social networks is a subject of growing interest. A relevant issue in those networks involves the identification of key influencers. These players have an important role on viral marketing strategies and message propagation, including political propaganda and fake news. In effect, an important way to fight malicious usage on social networks is to understand their properties, their structure and the way messages propagate. This paper proposes two new indices for analysing message propagation in social networks, based on the network topological nature and the power of the message. The first index involves the strength of each node as a launcher of the message, dividing the nodes into launchers and non launchers. The second index addresses the potential of each member as a receiver (target) of the message, dividing the nodes into targets and non targets. Launcher individuals should indicate strong influencers and target individuals should identify the best target consumers. These indices can assist other known metrics when used to select efficient influencers in a social network. For instance, instead of choosing a strong and probably expensive member according to its degree in the network (number of followers), we may previously select those belonging to the launchers group and look for the lowest degree members, which are probably cheaper but still guarantying almost the same influence effectiveness as the largest degree members. On a different direction, using the second index, the strong target members should characterize relevant consumers of information in the network, which may include fake news' regular collectors. We discuss these indices using small world randomly generated graphs and a number of real world social networks available in known datasets repositories.


Complex physical properties of a self organizing biological system. The physical interpretation of the functioning of the adaptive immune system, which maintains host integrity by accelerated protein evolution, provides a unique opportunity to observe and define a self organizing system in its entirety. Using a configuration space model of immune function, wherein directed chemical potentials of the system components create a vector space of interactions, the architecture of self organization suggests that a fractal scale free network distributes energy through the system. In the physical sense the adaptive immune system adjusts the chemical potential of all available molecules by tuning the chemical potential and organizing the network hierarchy of its sensor effector molecules, antibodies. Coupling of free energy sensors and effectors allows the system to regulate its composition, while network organization helps minimize chemical potentials and maximize diversity. Overall, a stochastic model of adaptive immunity may provide a universal physical model for self organizing systems with power law distribution of thermodynamic activities.


Object recognition for robotics from tactile time series data utilising different neural network architectures. Robots need to exploit high quality information on grasped objects to interact with the physical environment. Haptic data can therefore be used for supplementing the visual modality. This paper investigates the use of Convolutional Neural Networks (CNN) and Long Short Term Memory (LSTM) neural network architectures for object classification on Spatio temporal tactile grasping data. Furthermore, we compared these methods using data from two different fingertip sensors (namely the BioTac SP and WTS FT) in the same physical setup, allowing for a realistic comparison across methods and sensors for the same tactile object classification dataset. Additionally, we propose a way to create more training examples from the recorded data. The results show that the proposed method improves the maximum accuracy from 82.4 (BioTac SP fingertips) and 90.7 (WTS FT fingertips) with complete time series data to about 94 for both sensor types.


The structure of exceptional sequences on toric varieties of Picard rank two. For a smooth projective toric variety of Picard rank two we classify all exceptional sequences of invertible sheaves which have maximal length. In particular, we prove that unlike non maximal sequences, they (a) remain exceptional under lexicographical reordering (b) satisfy strong height constraints in the Picard lattice (c) are full, that is, they generate the derived category of the variety.


Simultaneous Localization and Mapping Related Datasets A Comprehensive Survey. Due to the complicated procedure and costly hardware, Simultaneous Localization and Mapping (SLAM) has been heavily dependent on public datasets for drill and evaluation, leading to many impressive demos and good benchmark scores. However, with a huge contrast, SLAM is still struggling on the way towards mature deployment, which sounds a warning some of the datasets are overexposed, causing biased usage and evaluation. This raises the problem on how to comprehensively access the existing datasets and correctly select them. Moreover, limitations do exist in current datasets, then how to build new ones and which directions to go? Nevertheless, a comprehensive survey which can tackle the above issues does not exist yet, while urgently demanded by the community. To fill the gap, this paper strives to cover a range of cohesive topics about SLAM related datasets, including general collection methodology and fundamental characteristic dimensions, SLAM related tasks taxonomy and datasets categorization, introduction of state of the arts, overview and comparison of existing datasets, review of evaluation criteria, and analyses and discussions about current limitations and future directions, looking forward to not only guiding the dataset selection, but also promoting the dataset research.


GIT stability of linear maps on projective space with marked points. We construct moduli spaces of linear self maps of N dimensional projective space with n marked points, up to projective equivalence. That is, we let the special linear group act simultaneously by conjugation on projective linear maps and diagonally on ( mathbb P N) n , and we take the geometric invariant theory (GIT) quotient. These moduli spaces arise in algebraic dynamics in two ways first, as ambient varieties of degree 1 portrait spaces second, as the domains of discrete integrable systems such as the pentagram map. Our main result is a dynamical characterization of the GIT semistable and stable loci in the space of linear maps with marked points. The proof is combinatorial to describe the weight polytopes for this action, we compute the vertices and facets of certain convex polyhedra generated by roots of the A N lattice.


Estimating the Steady State Diffusion Coefficient Using Data from the Transient Anomalous Regime. When particles molecules diffuse in systems that contain obstacles, the steady state regime (during which the mean square displacement scales linearly with time, left r 2 right sim t ) is preceded by a transient regime. It is common to characterize this transient regime using the concept of anomalous (sub)diffusion with the scaling law left r 2 right sim t alpha , where the corresponding exponent alpha 1 . We propose a new method to estimate the critical time t that marks the transition between these two regimes. The method uses short time data from the transient regime to estimate t , which can then be used to estimate the steady state diffusion coefficient D . In other words, we propose a procedure that makes it possible to estimate the steady state diffusion coefficient without reaching the steady state. We test the procedure with various two dimensional lattice systems.


Linearization of Poisson groupoids. Motivated by a search for Lie group structures on groups of Poisson diffeomorphisms 24 , we investigate linearizability of Poisson structures of Poisson groupoids around the unit section. After extending the Lagrangian neighbourhood theorem to the setting of cosymplectic Lie algebroids, we establish that dual integrations of triangular bialgebroids are always linearizable. Additionally, we show that the (non dual) integration of a triangular Lie bialgebroid is linearizable whenever the r matrix is of so called cosymplectic type. The proof relies on the integration of a triangular Lie bialgebroid to a symplectic LA groupoid, and in the process we define interesting new examples of double Lie algebroids and LA groupoids. We also show that the product Poisson groupoid can only be linearizable when the Poisson structure on the unit space is regular.


A Survey on Embedding Dynamic Graphs. Embedding static graphs in low dimensional vector spaces plays a key role in network analytics and inference, supporting applications like node classification, link prediction, and graph visualization. However, many real world networks present dynamic behavior, including topological evolution, feature evolution, and diffusion. Therefore, several methods for embedding dynamic graphs have been proposed to learn network representations over time, facing novel challenges, such as time domain modeling, temporal features to be captured, and the temporal granularity to be embedded. In this survey, we overview dynamic graph embedding, discussing its fundamentals and the recent advances developed so far. We introduce the formal definition of dynamic graph embedding, focusing on the problem setting and introducing a novel taxonomy for dynamic graph embedding input and output. We further explore different dynamic behaviors that may be encompassed by embeddings, classifying by topological evolution, feature evolution, and processes on networks. Afterward, we describe existing techniques and propose a taxonomy for dynamic graph embedding techniques based on algorithmic approaches, from matrix and tensor factorization to deep learning, random walks, and temporal point processes. We also elucidate main applications, including dynamic link prediction, anomaly detection, and diffusion prediction, and we further state some promising research directions in the area.


Scale invariant representation of machine learning. The success of machine learning has resulted from its structured representation of data. Similar data have close internal representations as compressed codes for classification or emerged labels for clustering. We observe that the frequency of internal codes or labels follows power laws in both supervised and unsupervised learning models. This scale invariant distribution implies that machine learning largely compresses frequent typical data, and simultaneously, differentiates many atypical data as outliers. In this study, we derive the process by which these power laws can naturally arise in machine learning. In terms of information theory, the scale invariant representation corresponds to a maximally uncertain data grouping among possible representations that guarantee a given learning accuracy.


Automatic Construction of Evaluation Suites for Natural Language Generation Datasets. Machine learning approaches applied to NLP are often evaluated by summarizing their performance in a single number, for example accuracy. Since most test sets are constructed as an i.i.d. sample from the overall data, this approach overly simplifies the complexity of language and encourages overfitting to the head of the data distribution. As such, rare language phenomena or text about underrepresented groups are not equally included in the evaluation. To encourage more in depth model analyses, researchers have proposed the use of multiple test sets, also called challenge sets, that assess specific capabilities of a model. In this paper, we develop a framework based on this idea which is able to generate controlled perturbations and identify subsets in text to scalar, text to text, or data to text settings. By applying this framework to the GEM generation benchmark, we propose an evaluation suite made of 80 challenge sets, demonstrate the kinds of analyses that it enables and shed light onto the limits of current generation models.


Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard. Leaderboards are a ubiquitous part of modern research in applied machine learning. By design, they sort entries into some linear order, where the top scoring entry is recognized as the "state of the art" (SOTA). Due to the rapid progress being made in information retrieval today, particularly with neural models, the top entry in a leaderboard is replaced with some regularity. These are touted as improvements in the state of the art. Such pronouncements, however, are almost never qualified with significance testing. In the context of the MS MARCO document ranking leaderboard, we pose a specific question How do we know if a run is significantly better than the current SOTA? We ask this question against the backdrop of recent IR debates on scale types in particular, whether commonly used significance tests are even mathematically permissible. Recognizing these potential pitfalls in evaluation methodology, our study proposes an evaluation framework that explicitly treats certain outcomes as distinct and avoids aggregating them into a single point metric. Empirical analysis of SOTA runs from the MS MARCO document ranking leaderboard reveals insights about how one run can be "significantly better" than another that are obscured by the current official evaluation metric (MRR 100).


All photon Polarimetric Time of Flight Imaging. Time of flight (ToF) sensors provide an imaging modality fueling diverse applications, including LiDAR in autonomous driving, robotics, and augmented reality. Conventional ToF imaging methods estimate the depth by sending pulses of light into a scene and measuring the ToF of the first arriving photons directly reflected from a scene surface without any temporal delay. As such, all photons following this first response are typically considered as unwanted noise. In this paper, we depart from the principle of using first arriving photons and propose an all photon ToF imaging method by incorporating the temporal polarimetric analysis of first and late arriving photons, which possess rich scene information about its geometry and material. To this end, we propose a novel temporal polarimetric reflectance model, an efficient capture method, and a reconstruction method that exploits the temporal polarimetric changes of light reflected by the surface and sub surface reflection. The proposed all photon polarimetric ToF imaging method allows for acquiring depth, surface normals, and material parameters of a scene by utilizing all photons captured by the system, whereas conventional ToF imaging only obtains coarse depth from the first arriving photons. We validate our method in simulation and experimentally with a prototype.


How to choose an Explainability Method? Towards a Methodical Implementation of XAI in Practice. Explainability is becoming an important requirement for organizations that make use of automated decision making due to regulatory initiatives and a shift in public awareness. Various and significantly different algorithmic methods to provide this explainability have been introduced in the field, but the existing literature in the machine learning community has paid little attention to the stakeholder whose needs are rather studied in the human computer interface community. Therefore, organizations that want or need to provide this explainability are confronted with the selection of an appropriate method for their use case. In this paper, we argue there is a need for a methodology to bridge the gap between stakeholder needs and explanation methods. We present our ongoing work on creating this methodology to help data scientists in the process of providing explainability to stakeholders. In particular, our contributions include documents used to characterize XAI methods and user requirements (shown in Appendix), which our methodology builds upon.